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Preface 


HQ  TAC/LGY  uses  Dyna-METRIC  as  a  WRSK  assessment  tool 
but  they  have  expressed  a  need  for  a  more  flexible  model 
that  is  capable  of  running  on  a  microcomputer.  The  purpose 
of  this  thesis  work  was  to  develop  a  model  to  emulate  and 
extend  the  Dyna-METRIC  modeling  capability. 

This  model  provides  the  initial  emulation  capability 
and  some  extended  capabilities  such  as  the  ability  to 
restrict  maintenance  and  to  have  flexible  scheduling.  Areas 
for  future  work  include  more  flexible  input  and  output 
formats  and  the  use  of  variance  reduction  techniques  to 
reduce  the  number  of  simulation  runs  necessary. 

In  an  effort  of  this  magnitude,  credit  rarely  rests 
with  just  the  author.  Therefore,  I  would  like  to  thank  my 
advisor  Ma j .  Phillip  Miller,  whose  time,  wisdom,  and 
patience  have  kept  my  thesis  train  from  derailing.  I  am 
also  grateful  to  Capt.  Richard  Mabe  and  Capt.  Michael  Budde 
for  teaching  me  the  secrets  of  Dyna-METRIC.  To  my  typist 
and  fiancee,  Marcia  Rossow,  thank-you  for  your  patience  and 
love  through  a  difficult  time  and  for  retyping  Chapter  4 
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when  the  computer  broke.  Finally,  to  God,  "For  from  Him  and 
through  Him  and  to  Him  are  all  things.  To  Him  be  the  glory 
forever.  Amen  (27:Romans  11:36)." 

Theodore  P.  Lewis 
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Abstract 

^  HQ  TAC/LGY  uses  Dyna-METRIC  as  a  WRSK  assessment  tool 
but  they  have  expressed  a  need  for  a  more  flexible  model 
that  Is  capable  of  running  on  a  microcomputer.  For  example, 
Dyna-METRIC  has  a  number  of  limiting  assumptions  such  as 
assuming  unlimited  maintenance  capacity.  The  purpose  of 
this  thesis  work  was  to  develop  a  model  to  emulate  and 
extend  the  Dyna-METRIC  modeling  capability.- 

To  begin  this  research  a  simulation  package  had  to  be 
chosen.  Microcomputer  simulation  languages  were  compared 
and  SLAM  II  PC  was  selected  because  of  its  price, 
portability,  widespread  acceptance  as  a  simulation  language, 
and  the  availability  of  the  software. 

Another  area  of  concern  was  Dyna-METRIC' s  use  of  the 
exponential  distribution  to  model  repair  times.  Questions 
have  arisen  as  to  whether  this  is  a  reasonable  assumption  or 
whether  the  lognormal  distribution  provides  a  better  fit. 

The  sample  repair  times  were  taken  from  a  TAC  exercise 
called  Coronet  Warrior.  The  results  were  inconclusive  due, 
primarily,  to  the  small  sample  sizes.  Testing  of  the 
research  model  centered  around  two  data  sets.  The  first  was 


provided  by  HQ  TAC/LGY  and  the  second  came  from  the  TAC 
Coronet  Varrlor  exercise.  The  outputs  of  interest  are 
sorties  per  day  and  number  of  full/  mission-capable  aircraft 
available  per  day.  Each  data  set  was  used  with  the  research 
and  Dyna-METRIC  models.  The  outputs  were  then  compared  by 
day  and  type.  A  hypothesis  test  of  the  differences  was 
performed.  The  differences  were  not  found  to  be 
statistically  different  from  zero.  Therefore,  the  research 
model  provides  a  reasonable  emulation  of  the  Dyna-METRIC 
model  with  respect  to  the  outputs  of  interest.  Future 
research  is  recommended  in  input  and  output  formats  and  in 
variance  reduction  techniques  to  reduce  the  number  of 
simulation  runs  necessary. 
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UNIT  LEVEL  WRSK  ASSESSMENT 
AND 

SORTIE  GENERATION 
SIMULATION  MODEL 


Tactical  Air  Command,  like  any  Air  Force  unit,  has  a 
need  to  manage  resources  e££iciently  and  assess  the 
capabilities  of  these  resources.  As  a  part  of  this 
management  effort,  the  Tactical  Resources  Analysis  office  at 
Tactical  Air  Command  headquarters  is  often  tasked  with 
analyzing  the  efficiency  of  Tactical  Air  Command's  resource 
allocation.  One  area  of  concern  is  the  management  and 
assessment  of  the  War  Readiness  Spares  Kit  (WRSK) 
recoverable  spares  (30).  The  War  Readiness  Spares  Kit  is 
the  Air  Force  standard  set  of  spares.  This  kit  allows  an 
Air  Force  unit  to  fight  for  30  days  without  external 
resupply.  Recoverable  spares  are  those  parts  in  the 
aircraft  which  can  be  repaired  and  used  again.  To  model 
this  situation.  Tactical  Air  Command  Resources  Analysis 
office  uses  Dynamic  Multi-Echelon  Technique  for  Recoverable 
Item  Control  (Dyna-METRIC) .  Dyna-METRIC  is  an  analytical 


V 


model  which  runs  on  a  mainframe  computer  at  Tactical  Air 
Command  headquarters  (30).  Although  Dyna-METRIC  is  a 
flexible  tool,  it  has  a  number  of  limitations  due  to  its 
analytical  nature,  which  have  restricted  its  effectiveness 
in  realistically  predicting  sortie  generation  rates  (number 
of  times  an  aircraft  can  fly  per  day)  and  WRSK  capability  at 
the  squadron  level.  This  model  assumes,  for  example,  that 
unlimited  maintenance  personnel  and  test  equipment  are 
available,  that  all  parts  are  mission-essential,  and  that 
all  parts  fail  at  the  Air  Force  wide  failure  rate  (15:1). 

Due  to  these  shortfalls  Tactical  Air  Command  wants  a  more 
flexible  model  which  can  emulate  Dyna-METRIC  for  validation 
purposes  and  yet  can  also  be  expanded  to  address  the  areas 
where  Dyna-METRIC  is  limited  (15:2). 


Specific  Problem 

The  specific  problem  is  that  TAC  lacks  a  flexible  tool 


to  use  in  evaluating  current  WRSK  needs  and  capabilities 
because  the  current  model  has  restrictive  assumptions. 


Develop  a  tool  that  emulates  the  Dyna-METRIC 
resource  management  and  spares  capability  assessment  model 
and  is  also  capable  of  addressing  Dyna-METRIC  shortfalls, 
yet  still  runs  on  a  microcomputer. 

Sub-objectives 

The  sub-objectives  are  to: 

-  Investigate  the  limitations  of  Dyna-METRIC. 

-  Evaluate  the  solution  techniques  available 
and  choose  the  most  suitable  one  for  Tactical  Air 
Command's  resource  management  needs. 

-  Develop  a  model  that  emulates  Dyna-METRIC  at 
the  squadron  level,  yet  is  capable  of  being  expanded  to 
address  selected  Dyna-METRIC  limitations  to  include  the 
following : 

—  An  aircraft  scheduling  module  that 
includes  daily  flight  schedules. 

—  Flightline  and  intermediate  level 
maintenance  constraints. 

-  Develop  an  interface  for  use  with  the 
Dyna-METRIC  input  data  base. 

-Provide  an  appropriate  output  to  the  model 


user . 


-Provide  user  documentation  for  the  model. 

The  rest  of  this  document  gives  the  steps  taken  to  meet 
these  objectives.  Chapter  Two  provides  a  review  of  the 
literature  pertinent  to  this  research,  while  Chapter  Three 
discusses  the  approach  or  methodology  used.  Chapter  Four 
reports  the  analysis  and  results  of  testing.  Chapter  Five 
will  draw  conclusions  and  suggest  areas  for  future  research. 
The  appendices  will  include  data  tables,  model  flow 
diagrams,  model  coding,  and  model  output. 
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2-l.  Literature 


Models 

A  model  is  an  abstraction  or  idealization  of  a  real 
world  situation  (29:211).  As  with  any  imitation,  it 
provides  an  incomplete  representation  of  the  real  thing, 
says  Specht.  Pritsker  gives  four  reasons  for  simulation 
models : 

...  as  explanatory  devices  to  define  a  system  or 
problem;  as  analysis  vehicles  to  determine  critical 
elements,  components,  and  issues;  as  design  assessors 
to  synthesize  and  evaluate  proposed  solutions;  as 
predictors  to  forecast  and  aid  in  planning  future 
developments  [23:1]. 

The  purpose  of  this  research  model  falls  in  the  second  and 
fourth  categories.  Specht  (29:212)  and  Pritsker  (23:11-12) 
both  agree  that  the  scope  and  complexity  of  the  model  are 
dependent  on  the  problem  to  be  solved.  This  implies  that 
problem  definition  is  critical  in  developing  an  appropriate 
model.  Both  Pritsker  (23:11)  and  Specht  (29:218)  also  agree 
that  deciding  what  is  relevant  in  the  model  and  the  criteria 
or  objectives  of  the  analysis  are  important.  Pritsker 
provides  a  ten-step  evolutionary  process  which  he  recommends 
for  developing  a  simulation  model.  The  steps  are: 

1)  problem  formulation 

2)  model  building 


3)  data  acquisition 

4)  model  translation 

5)  verification 

6)  validation 

7)  strategic  and  tactical  planning 

8)  experimentation 

9)  analysis  of  results 

10)  Implementation  and  documentation  (23:11). 

These  are  similar  to  the  steps  given  by  Lee,  Moore,  and 

Taylor  (18:463).  Pritsker  points  out  that  no  simulation 

project  is  complete  until  it  is  used  in  the  decision  making 

process  (23:13)  but  Ellsberg,  a  Rand  staff  member,  also 

warns  that  the  use  of  models 

...  will  not  eliminate  uncertainty  or  insure 
correctness;  will  not  forsee  all  major  problems, 
goals,  contingencies,  and  alternatives;  will  not 
eliminate  the  necessity  of  judgement  or  the  effect 
of  bias  or  preconception  [29:226-7]. 

Ellsberg  does  agree,  however,  that  it  should  enhance  the 

decision  process  (29:227). 


Simulation 

Dalkey  says  that  simulation  is  one  of  the  most 
Important  tools  of  the  military  analyst  because  military 
conflict  involves  a  complex  interaction  of  many  items 
including  weapons,  strategies,  and  time.  He  also  points  out 
that  it  is  often  the  only  method  which  can  provide  accurate 
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and  reproducible  results  (8:241).  Lee,  Moore,  and  Taylor 
state  that  the  primary  reason  for  simulation  is  that  many 
real  world  problems  do  not  lend  themselves  to  mathematical 
modeling  and  solution  to  optimality  because  of  stochastic 
relationships  or  problem  complexity  (18:461).  They  also 
indicate  that  one  reason  for  the  popularity  of  simulation  i 
its  flexibility,  which  allows  fitting  the  model  to  the 
problem  rather  than  the  problem  to  the  model  (18:491).  A 
number  of  examples  of  simulation  applications  are  given  by 
Pritsker  (23:Chap  4),  Lee,  Moore,  and  Taylor  (18:489),  and 
Dalkey  (8:248).  The  applications  touch  almost  every  aspect 
of  the  business  and  military  world. 

Before  using  simulation,  however,  the  advantages  and 
disadvantages  of  simulation  should  be  weighed.  The 
advantages  given  by  Dalkey  include  the  ability  to  handle 
complex  systems  and  the  ability  to  break  down  the  system 
into  smaller,  simpler  sections,  creating  more  easily 
understood  situations  for  the  decision  maker.  Also,  the 
assumptions  are  usually  clearly  stated  and  results  can  be 
duplicated.  Simulation  provides  a  logical  framework  and 
often  can  be  used  as  a  self-check  of  the  model  assumptions 
(8:250).  Pritsker  would  also  add  that  simulation  allows 
drawing  inferences 

...  without  building  them,  if  they  are  only 
proposed  systems;  without  disturbing  them  if  they 
are  operating  systems  that  are  costly  or  unsafe  to 
experiment  with;  without  destroying  them,  if  the 
object  of  an  experiment  is  to  determine  their 
limits  of  stress  (23:61. 


Dalkey  also  gives  sons  disadvantages  o£  simulation.  For 


example,  simulation  Is  often  a  slow  and  cumbersome  method 
for  solving  a  problem.  The  models  can  be  difficult  to 
change  and  restricted  to  only  a  few  situations.  The  results 
are  often  treated  with  undue  respect  and  there  Is  also  a 
tendency  for  the  user  to  treat  the  model  as  a  black  box  with 
no  understanding  as  to  what  is  going  on  Inside  the  model. 

It  Is  also  difficult  to  simulate  a  commander's  decisions 
(8:251).  In  choosing  to  use  simulation  both  the  strengths 
and  weaknesses  should  be  kept  In  mind. 

Readiness  Snares  &1&  ( WRflK ) 

Basic  military  doctrine  centers  on  three  subjects. 

These  areas  are  the  weapon  system,  the  supply  or  logistics 
system,  and  manpower.  Manpower  and  logistic a  are  the 
Independent  variables,  while  the  weapon  system  Is  the 
dependent  variable  (10:1).  To  stress  the  Importance  of 
logistics.  General  Eisenhower  said,  "You  will  not  find  it 
dlf £ lcult, . . . ,to  prove  that  battles,  campaigns,  and  even 
wars  have  been  won  or  lost  primarily  because  of  logistics 
(14:XII)."  During  peacetime  operations,  supplies  are  kept 
close  to  where  they  will  be  used  but,  when  hostilities 
arise,  units  can  be  deployed  worldwide  outside  of 
established  supply  chains.  Due  to  the  need  to  plan  for 
these  contingencies,  the  military  has  developed  the  War 


Reserve  Material  Program.  This  program  is  designed  to 
support  deployed  operating  units  and  relies  on 
prepositioning  of  materials  based  on  preplanned  programs  and 
schedules  (32:14-3).  In  the  event  of  hostilities  the  War 
Reserve  Material  (WRM)  stock  is  additional  equipment  held  in 
reserve  which  supplements  normal  peacetime  operating  stocks 
until  industrial  production  can  sustain  combat  requirements. 
It  includes  spares,  equipment,  war  consumables,  and  medical 
material  designated  as  WRM  by  APR  400-24  (36:1).  The  War 
Readiness  Spares  Kit  (WRSK)  is  a  part  of  the  war  Reserve 
Material  program  for  units  with  aircraft,  vehicles, 
communication  systems  and  other  appropriate  systems.  A  WRSK 
is  defined  as  an  air-transportable  kit  of  critical  spare 
parts  to  provide  sustained  operations  during  wartime  or 
contingency  when  normal  supply  channels  are  interrupted  or 
fall  short  of  demand.  They  are  meant  to  sustain  a  unit  for 
some  specified  period  of  time  (usually  30  days)  without 
external  resupply  (32:14-13). 

The  development  of  the  War  Reserve  Material  Program 
began  at  the  end  of  World  War  II.  The  need  for  some  war 
readiness  capability  was  evident  from  America's  lack  of 
capability  at  the  beginning  of  World  War  II  and  from  the 
post-war  political  climate.  In  1946  the  original 
requirements  for  a  readiness  capability  centered  around  the 
deployment  of  bulk  supplies  and  equipment  and  the  need  for  a 
30  day  unsupported  maintenance  capability,  in  1946  the 
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Strategic  Air  Command  created  an  airborne  kit  which  would 
allow  aircraft  operations  for  30  days  from  forward  bases 
without  any  logistics  support  (13:5). 

Literature  on  war  readiness  material  is  scarce  and 
focuses  predominently  on  how  to  deal  with  funding  problems 
and  lack  of  war  readiness  materials,  rather  than  on  the 
development  of  the  proper  war  readiness  material  stock 
composition.  This  situation  should  be  expected  because  the 
determination  of  logistics  requirements  has  always  been 
difficult.  This  is  due  in  part  to  the  constant  changes  in 
requirements  to  support  contingencies  (13:6). 

The  primary  planning  document  for  War  Reserve  Material 
is  the  War  and  Mobilization  Plan  (WMP).  In  time  of  war, 
support  needs  are  met  by  the  peacetime  operating  stock  and 
the  War  Reserve  Materials  stock.  This  reserve  stock 
provides  additional  equipment  so  that  military  units  can  go 
from  low  peacetime  consumption  rates  to  high  wartime 
consumption  rates.  The  basis  for  these  changes  in 
consumption  rates  is  established  in  the  DOD  Defence  Guidance 
(DG).  Details  on  specific  forces  and  scenarios  used  to 
determine  requirements  are  in  the  WMP-1  (35:5).  The  policy 
and  responsibilities  for  management  of  War  Reserve  Materials 
is  contained  in  Air  Force  Regulation  400-24.  Air  Force 
Manual  67-1  provides  further  details  on  these 
responsibilities.  The  logistician  faces  a  difficult  problem 
in  determining  WRSK  composition  because  of  the  need  to 


predict  demand  under  uncertain  conditions.  Also,  his 

resources  are  limited  because 

...  prepositioning  and  prestocking  War  Reserve  Material 
in  the  range  and  scope  necessary  to  cope  with  every 
possible  combination  of  circumstances  would  bankrupt 
the  country  [13:4]. 

He  must,  therefore,  budget  his  resources  to  provide  the  best 
mix  of  mobility  and  flexibility  across  the  range  of  conflict 
(13:4)  . 

Tactical  Air  Command  uses  War  Readiness  Spares  Kits  in 
order  to  accomplish  this  goal.  These  War  Readiness  Spares 
Kits  represent  the  sole  source  of  aircraft  spare  parts 
during  the  initial  phases  of  conflict.  Because  of  the  need 
to  deploy  worldwide  and  operate  initially  as  a  logistically 
independent  unit,  these  kits  are  prepositioned  with  the  unit 
and  are  air-transportable  (32:14-13).  The  kits  are 
comprised  of  the  following  three  elements: 

— Enroute  Support  Team  (EST) 

— Initial  Support  Element  (ISE) 

— Tactical  Support  Element  (TSE) 

The  Enroute  Support  Team  (EST)  includes  the  WRSK  assets 
required  to  move  the  aircraft  to  the  deployed  site.  The 
Initial  Support  Elements  (ISE)  are  WRSK  assets  necessary  to 
support  operations  during  the  first  seven  days  of  the 
deployment.  Combined  with  the  Enroute  Support  Team,  they 
form  the  Leading  Edge  package  and  are  built  to  support  a 
deployed  unit  at  WMP-5  surge  rates  (33:9-10).  The  Tactical 
Support  Element  is  the  remaining  WRSK  necessary  to  sustain  a 
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deployment  from  day  eight  to  day  thirty.  TAC  uses  the 
following  criteria  to  measure  WRSK  program  effectiveness: 

A)  Inventory  accuracy 

B)  Control  of  shelf  llfe/functlonal  check  Items 

C)  Accuracy  of  WRSK  authorizations 

D)  Receiving  and  storing  of  assets 

B)  Issuing  Assets 

F)  Appearance  of  the  WRSK.  (33:3) 

War  Reserve  Material  is  crucial  to  USAF  war  planning, 
thus  supervision,  control,  and  use  of  this  material  falls  to 
the  storing  command.  This  material  should  be  segregated 
from  other  base  supply  stocks.  Although  a  war  Readiness 
Spares  Kit  (WRSK)  may  be  used  to  bring  an  aircraft  or  end 
items  authorized  war  reserve  material  support  back  to 
operational  condition,  it  should  not  be  considered  a  source 
of  continuous  supply  because  of  its  wartime  mission 
(32:14-5).  Selection  criteria  for  war  reserves  reside  in 
AFR  400-24.  They  include  such  things  as: 

-  items  essential  for  combat  forces: 

--  to  destroy  an  enemy's  capacity  to 
continue  fighting. 

—  to  give  battlefield  protection  of 
personnel. 

—  to  detect,  locate,  and  maintain 
surveillance  of  the  enemy. 

--  to  communicate  under  war  conditions. 
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-  items  essential  for  operational 
effectiveness  of  combat  support  units. 

-  items  essential  to  effective  weapon 
or  equipment  operation. 

-  items  essential  for  sudden  mobilization  or 
deployment . 

-  items  designated  as  operational  rations 
(35:4)  . 

TAC  units  are  tasked  to  use  the  dedicated  crew  chief 
program  for  aircraft  WRSK  management  and  each  crew  chief  is 
responsible  for  managing  all  facets  of  his  WRSK  kit 
(33:2-3).  The  Non-Commissioned  Of f icers-In-Charge  of  the 
War  Readiness  Section  in  the  Aircraft  Generation  Parts  Store 
or  the  Non-Commissioned  Officer-In-Charge  of  the  Tactical 
Air  Control  System  Material  Control  are  the  WRSK/BLSS  (Base 
Level  Self-sufficiency  Spares)  custodians  (33:7).  Resupply 
of  the  War  Readiness  Spares  Kit  comes  from  two  sources.  The 
first  is  from  repair  in  the  field  and  the  second  is  from 
resupply  channels.  Items  that  are  removed  on  the  flight 
line  are  sent  to  field  level  maintenance  for  repair  and  then 
returned  to  the  WRSK.  Items  broken  beyond  the  unit's  repair 
capability  are  sent  to  a  higher  level  and  a  new  part  is 
ordered  (10:23) . 
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Demmy  and  Hobbs  give  some  background  to  the  Dynamic 
Multi-Echelon  Technique  for  Recoverable  Item  Control 
(Dyna-METRIC)  model.  Work  began  on  optimization  techniques 
for  stationary,  multi-echelon,  multi-indenture 
inventory/repair  systems  in  1966  by  Feeney  and  Sherbrooke. 
This  model  calculated  backorder  levels  for  depot  and  base 
stock  levels  and  provided  the  basis  for  recoverable  item 
requirements  in  the  Air  Force  (9:14). 

Pyles  gives  the  need  for  the  Dyna-METRIC  model 
development  by  stating,  "A  technique  that  merely  assesses 
alternate  logistics  decisions  would  be  inadequate"  (24:1). 
Because  of  the  large  number  of  items  managed,  there  is  a 
need  for  a  forecasting  technique  which  can  identify  spares 
shortfalls.  Pyles  emphasizes  that  previous  models  always 
looked  at  noncombat  measures  such  as  part  backorders  while 
Dyna-METRIC  assesses  how  alternate  part  support  processes 
and  resources  will  impact  combat  capability  (24:1).  Pyles 
and  Tripp  also  stress  the  Air  Force  Logistics  Command's 
interest  in  developing  a  tie  between  support  decisions  and 
combat  effectiveness.  Two  important  aircraft  measures  of 
effectiveness  are  the  number  of  fully  mission-capable 
aircraft  and  the  number  of  sorties  flown  based  on  war  plans 
or  peacetime  flying  goals  (25:18). 


The  original  METRIC  model  was  based  on  a  steady  state 
inventory  system  with  constant  average  demand  rates  and 
constant  average  service  rates  (16:1).  The  demand  rates  in 
certain  situations  such  as  wartime  or  peacetime  exercises 
are  not  steady  state  (16:1).  Hillestad  and  Carrillo  in 
their  Rand  note  give  a  development  o£  the  mathematics 
necessary  to  handle  this  transitory  state  (16).  They  also 
stress  the  importance  o£  three  assumptions  inherent  in  this 
model.  These  assumptions  are  '‘sufficient  slack  service 
capacity.  Independence  of  the  service  and  demand  process  and 
polsson  arrivals  (16:23)."  If  these  assumptions  are  not 
valid  for  a  given  situation,  then  the  results  may  no  longer 
be  valid  (16:32) . 

Demmy  and  Hobbs  describe  Dyna-METRIC  in  the  following 
manner.  Dyna-METRIC  has  a  three-layer  inventory  and  repair 
system  consisting  of  a  depot,  a  flexible  number  of 
centralized  intermediate  repair  facilities,  and  the  main 
operating  bases.  The  depot  portion  of  the  model  is  limited. 
The  model  enables  the  user  to  either  include  or  exclude  the 
intermediate  repair  stations  depending  on  his  or  her 
environment.  The  internal  flow  of  parts  within  the  model 
depends  on  the  repair  capability  assigned  to  each  level  of 
repair.  For  example,  main  operating  bases  usually  have 
limited  repair  capability.  An  item  that  fails  is  removed 
from  the  aircraft  and  replaced  with  a  serviceable  (operable) 
spare.  The  item  that  is  removed  and  replaced  on  the  flight 
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line  is  called  a  line  replaceable  unit  (LRU).  These  units 
are  then  sent  to  base  supply.  Based  on  the  severity  of  the 
problem  and  the  availability  of  a  centralized  intermediate 
repair  facility,  the  part  will  either  be  repaired  at  the 
base,  sent  to  a  centralized  repair  facility,  or  sent  to  the 
depot.  Base  resupply  within  the  model  is  accomplished  in  a 
similar  manner.  Depending  on  where  the  item  is  repaired, 
the  part  will  flow  back  to  the  base  from  that  station 
(9:14-15).  Two  things  should  be  noted.  First,  where  the 
part  is  repaired  has  a  significant  effect  on  resupply  time 
and  second,  resupply  is  always  done  on  a  one-for-one 
exchange  between  the  base  and  the  repair  station  (9:15). 

According  to  Gage  and  Ogan,  the  model  has  a  number  of 
limitations  which  should  be  kept  in  mind  when  considering 
possible  operating  scenerios  and  when  using  the  results 
obtained  from  the  model  (12:23-24).  First,  the  actual 
number  of  sorties  flown  can  never  be  more  than  the  number 
demanded.  This  may  give  the  false  impression  that  a  unit 
can  do  no  better  than  the  expected  sortie  rate,  which  is 
obviously  misleading.  Secondly,  the  number  of  sorties 
demanded  sets  the  consumption  of  spares  rather  than  the 
actual  number  of  sorties  flown.  This  limitation  implies 
that  spares  are  used  as  though  all  missions  are  being  flown 
even  when  all  are  not  being  flown.  Next,  the  model  does  not 
discriminate  between  grounded  (non-mission  capable)  aircraft 
and  aircraft  which  are  capable  of  performing  some  but  not 


all  of  their  missions  (partially  mission  capable).  The 
model  counts  all  broken  aircraft  as  non-mission  capable, 
distorting  the  analysis.  Another  limitation  is  the  fact 
that  ample  repair  facilities  are  always  assumed  to  be 
available  to  perform  repairs.  This  limitation  implies  that 
there  is  never  a  backlog  in  the  maintenance  shop  and  thus, 
there  is  never  a  delay  in  a  repair  because  of  a  sudden 
increase  in  broken  parts.  This  can  lead  to  a  better  repair 
time  than  actually  exists,  an  underestimate  of  spares  needs, 
and  therefore,  a  shortage  of  parts.  The  model  also  assumes 
that  repair  and  demand  processes  are  independent.  The 
repair  process  is  a  first-in,  first-out  line  regardless  of 
the  importance  or  need  of  the  flight  line.  Therefore,  if  a 
part  is  really  needed  on  the  flight  line,  it  can  not  be 
rushed  or  placed  at  the  front  of  the  line.  The  failure  rate 
of  parts  is  assumed  to  only  be  affected  by  the  number  of 
hours  flown.  The  depot  is  considered  to  be  an  infinite 
source  of  parts  and  therefore,  parts  will  never  be  out  of 
stock.  This  assumption  implies  that  the  depot  is  always 
able  to  issue  parts  immediately.  Finally,  the  model  assumes 
that  the  centralized  intermediate  repair  facilities 
distribute  spares  based  on  cumulative  flying  hours  and  no 
other  basis.  This  limits  the  flexibility  of  meeting  unique 
base  needs  or  shortages  within  the  model  and  therefore  is  a 
pessimistic  assumption  (12:23-24).  Despite  these 
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limitations  Dyna-METRIC  is  still  a  powerful  tool  as  Demmy 
and  Hobbs  point  out. 


The  usefulness  of  Dyna-METRIC  appears  to  be  in  its 
ability  to  evalute  the  dynamic  response  of  a  logistics 
system  when  operated  in  various  configurations  and 
under  various  policy  alternatives  relating  to 
transportation,  provisioning,  maintenance,  and 
deployment.  It  provides  performance  measures  at  both 
the  item  and  system  levels  which  increases  its  utility 
as  a  tool  for  aiding  decision  making  [9:171. 

Microcomputers 

One  of  TAC's  requirements  is  that  the  simulation  model 
be  available  on  a  microcomputer  (15).  Arthur,  Frendewey, 
Ghandf oroush,  and  Rees  did  an  extensive  review  of  over  20 
microcomputer  simulation  packages  (3).  They  point  out  that 
the  new  widespread  availability  of  simulation  packages  for 
the  microcomputer  is  making  simulation  much  more  affordable. 
However,  they  also  state  that  if  the  user  has  reasonable 
access  to  a  mainframe,  the  mainframe  is  almost  always 
preferable,  primarily  for  speed  reasons  (3:167-168).  The 
review  had  two  purposes.  The  first  was  to  provide  a  good 
list  of  simulation  packages  available  for  the  microcomputer 
and  the  second  was  to  further  investigate  several  of  the 
simulation  packages  which  have  mainframe  counterparts 
(3:168).  They  looked  only  at  how  well  the  language  was 
implemented  on  the  microcomputer  and  not  the  inherent 
quality  of  the  language.  They  also  did  not  identify  a  best 
overall  package  (3:168). 


Table  10  found  in  Appendix  A  gives  a  summary  of  the 
simulation  packages  in  this  article  (3:169-172).  The  four 
microcomputer  implementations  that  Arthur  and  the  others 
considered  in  detail  were  GPSS/PC,  SIMAN,  SLAM  II  PC,  and  PC 
SIMSCRIPT  I I. 5.  They  believe  that  these  are  the  most 
commonly  used  mainframe  simulation  languages.  They  also 
feel  these  four  microcomputer  versions  are  quality 
implementations  of  their  mainframe  counterparts  (3:173). 

Table  1,  taken  from  the  article,  gives  a  list  of  the 
operating  requirements  for  each  microcomputer  simulation 
language . 

Table  1  Operating  Requirements 

(Reprinted  from  3:174) 


GPSS 

SI  MAN 

Type  of  computer 

IBM  PC  or 
compatibles 

IBM  PC  or 
compatibles 

Memory 

236K 

320K 

Disk  drives 

1  Floppy 

2  Floppy;  Hard 
disk  recom¬ 

mended 

Opera tut|  system 

DOS  1.1.  2.0 

MS-DOS  LXX 

FORTRAN  compiler 

No 

Yes' 

required 

Numeric  processor 

No 

Recommended 

•Only  ooe  floppy  drive  required  for  network  models. 
'Not  required  for  block  diagram  models. 

'Not  required  for  network  models. 


SLAM 

illBSaiilZall 

IBM  PC  or 

One  baaed  on 

the  Intel 
Wtt/tt. 
S01M/SS.  or 
*02*6  chip 
family 

320K 

320K  (640K. 
preferred) 

2  Floppy*; 

3  megabytes 

Hard  disk  tec- 

bard  disk 

MS-DOS  LXX 

PC-DOS  k 
corresponding 
versions  of 
MS-DOS 

Yes' 

No 

BwemnymHflH 


Required 


Table  2,  also  taken  from  the  article,  gives  a  concise 
comparison  o£  the  four  languages. 


Table  2  Language  Comparison 

(Reprinted  from  3:174) 


I*  Modeling  ippmcfa 
E«m 


Continuous 


No 

Ym 

No 

PMMLCO* 


Ym 

Ym 

Ym 

PMMLCO 


Ym 

Ym 

Ym 

PMMLCO 


Ym 

Ym 

No 

PMMLCO 


Gatcnboa  method 

Cm  user  supply  s 
generator? 

3.  Support 

Built-in  random 


distributor! 


412  sse 

a «  I  sse 


User’s  Manual 

6.  Ease  at  getting 

model  to  ran 

7.  Ease  a I  modifyiag 

the  model 
I-  Output  analyse 


Fair 

Par 


Eaosttsnt/Good 


9.  Report 


10.  Portable  to 


provided 


11.  Coet  (non-educators/ 


EiosUmt 


$900/900 


$1300/200 


$973/200 


$24000/230 


•PMMLCO  - 


The  authors  stress  that  the  responses  in  the  table  are 
subjective  and  based  on  their  wide  experience  and  not  on  any 
large  sample  questionnaire  of  users.  The  authors  also 
indicate  that  they  only  looked  at  basic  simulation  packages 
and  not  any  enhancements  which  might  be  available  (3:173). 
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In  reviewing  Table  2,  the  authors  pointed  out  a  number  of 
items  which  are  important  to  this  thesis.  First  of  all, 

GPSS  is  limited  to  process-interaction  type  models  and 
SIMSCRIPT  can  not  model  continuous  systems.  All  packages 
are  considered  at  least  good  in  support  issues  and  excellent 
in  language  documentation.  User  manual  documentation, 
however,  varies  significantly.  When  considering  run  times, 
the  authors  stress  that  the  reader  should  not  compare  times 
between  packages  because  runtime  is  very  dependent  on  what 
is  being  modeled.  The  most  important  thing  to  note  is  the 
Increase  in  runtime  between  the  mainframe  and  the 
microcomputer  versions.  The  authors  rated  all  languages  at 
least  good  when  trying  to  modify  or  run  a  model  except 
SIMAN,  which  was  somewhat  more  difficult  to  run.  Excellent 
output  analysis  was  available  with  all  packages  except 
SIMSCRIPT  II. 5.  All  packages  were  completely  portable  to  a 
mainframe  except  GPSS  which  is  90\  portable.  Finally,  cost 
was  considered.  Because  of  TAC's  requirement  for  multiple 
site  implementation  of  this  model  (30),  SIMSCRIPT  II. 5 
quickly  becomes  cost  prohibitive  at  24,000  dollars  a  copy. 
The  other  three  packages  are  comparably  priced  at  about  1000 
dollars  and  should  be  considered  further. 

Several  other  languages  also  exist  and  should  be 
considered.  Vasudev  and  Biles,  seeing  the  need  for  a 
microcomputer  simulation  language,  are  pushing  for  the 
development  of  a  mainframe-like,  general  purpose  simulation 
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language  and  recommend  Pascal  Simulation  Modeling  and 
Analysis  Program  (PASMAP)  as  a  step  toward  fulfilling  that 
need.  The  Pascal  simulation  package  combines 
discrete-event,  continous,  and  state  event  simulation.  It 
also  allows  user  input  and  output  Interaction  (14:30-31). 
However,  there  is  one  critical  shortfall  of  this  model  for 
this  thesis.  This  package  is  still  under  development  and 
not  available  for  use.  Another  simulation  package  to 
consider  is  UCSD  Pascal.  O'Keefe  and  Davies  give  a  number 
of  reasons  to  use  UCSD  Pascal  (22).  First,  UCSD  Pascal 
tends  to  be  self-documenting  and  easy  to  learn.  Also, 
because  of  the  Pascal  implementation,  the  size  of  a 
simulation  program  is  not  an  effective  barrier  (22:25). 

There  is  one  Important  problem.  UCSD  Pascal  is  only 
available  on  Apple  II  computers  and  not  the  Zenith  computers 
(30)  . 

Verification  and.  Validation 

Whenever  a  model  Is  built,  the  question  usually  arises, 
"Does  the  model  represent  reality  ?"  In  addition,  this 
question  is  asked,  "Why  not  just  use  historical  data  for 
validation  ?"  Dalkey  says  the  modeler  usually  can  not 
guarantee  a  model  of  reality.  Use  of  historical  data  is 
often  difficult  because  it  is  not  available  especially  in  a 
scenario  similar  to  the  model.  Even  if  historical  data  is 


available,  the  results  might  disagree  and  the  model  still  be 
valid.  This  occurs  because  of  the  effects  of  chance,  the 
level  of  detail  in  the  model,  and  the  commander's  decisions 
on  historical  outcomes.  A  major  determinant  in  war  is  a 
commander's  decisions  and  presently  there  is  no  adequate  way 
to  model  this  process  (8:251-2).  Specht  also  has  something 
to  say  on  these  matters.  He  points  out  that  often,  because 
of  the  lack  of  data,  the  builder  can't  adequately  test  the 
model  but  hopefully  the  model  can  answer  the  following: 

-  Can  the  model  describe  correctly  and 
clearly  the  known  facts  and 
situations  ? 

-  Do  the  results  remain  constant  and 
plausible,  when  the  principal 
parameters  involved  are  varied  ? 

-  Can  the  model  handle  special  cases  in 
which  there  is  some  indication  as  to 
what  the  outcome  should  be  ? 

-  Can  the  model  assign  causes  to  known 

effects  ?  (29:220) 

Shannon  says  it  is  impossible  to  prove  that  any  simulation 
is  a  correct  or  true  model  of  reality  but  stresses  that  we 
are  seldom  concerned  with  proving  truth.  Instead,  he 
promotes  validating  the  Insights  gained  from  the  simulation. 
This,  he  stresses,  is  the  utility  of  a  model,  not  truth 
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(28:29).  Specht  adds  that  the  modeler  should  not  be 
concerned  that  the  model  doesn't  look  like  the  real  thing  or 
that  it  doesn't  model  all  of  reality.  He  indicates  that  the 
important  point  is  that  the  output  of  the  model  is 
reasonable  and  valid,  adding  that  several  models  may  even 
exist  for  the  same  reality  because  model  structure  depends 
on  the  object  modeled,  the  questions  asked,  and  the 
decisions  affected  (29:212). 

Since  the  ultimate  goal  of  any  model  is  to  aid  decision 
making,  the  builder  would  like  to  test  for  the  correctness 
and  relevance  of  the  results.  Since  this  is  not  always 
possible,  often  the  best  thing  to  hope  for  is  truthfulness 
(12:212).  Further,  no  matter  how  the  modeler  strives  to 
maintain  a  scientific  Inquiry  or  to  follow  scientific 
methods,  military  systems  analysis  is  not  an  exact  science. 
Although  it  may  appear  purely  rational,  coldly  objective, 
and  analytical,  don't  be  fooled.  Human  judgement  is  used 
for:  1)  designing  the  analysis  2)  choosing  alternatives,  3) 
choosing  relevant  factors,  4)  picking  interrelationships,  5) 
gathering  data  and  6)  analyzing  and  interpreting  results. 
Thus,  Quade  cautions  both  analyst  and  decision  maker  to 
avoid  errors  that  bias  results  (26:363).  Specht  gives  a 
similar  warning; 

This  fact  -  that  judgement  and  intuition  and 
guesswork  are  embedded  in  a  model  -  should  be 
remembered  when  we  examine  the  results  that  come, 
with  high  precision,  from  a  model  (29:2201. 


Verification  and  validation  should  be  performed 
whenever  a  model  Is  built.  There  are  a  number  of 
definitions  available  for  these  terms.  Shannon  says  that 
validation  is  "Increasing  to  an  acceptable  level  the 
confidence  that  an  inference  drawn  from  the  model  about  the 
real  system  will  be  correct  (28:23)."  Pritsker  says 
validation  is  the  "process  of  establishing  that  a  desired 
accuracy  or  correspondence  exists  between  the  simulation 
model  and  the  real  system  (23:11)."  While  verification  is 
the  "process  of  establishing  that  the  computer  program 
executes  as  intended  (23:11)."  Fishman  and  Kurat  divide 
model  evaluation  into  three  categories;  1)  Verification  - 
model  behaves  as  the  modeler  intended,  2)  Validation  - 
testing  the  model  vs.  the  real  world,  3)  Problem  Analysis  - 
model  capable  of  drawing  significant  inferences  from  the 
simulation  (28:20) . 
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Figure  1.  Verification  and  Validation  Concepts  (19) 


The  preceding  figure  gives  a  conceptual  picture  of  the 


verification  and  validation  process. 


Shannon  gives  three  tests  that  could  be  used:  1) 


testing  the  face  value  of  the  model  (experts  In  the  field 


look  at  the  structure  and  at  the  input/output  transformation 


to  see  If  they  can  tell  the  difference  between  the  real 


world  and  model  data),  2)  testing  model  assumptions  and  3) 


testing  Input/output  transformations  to  the  real  world.  Two 


and  three  above  can  use  a  variety  of  statistical  tests 


including  tests  of  means  and  variances,  analysis  of 
variance,  regression  analysis,  factor  analysis,  spectral 
analysis,  autocorrelation,  chi-square  tests,  and 
non-parametr ic  tests.  But  Shannon  warns  the  tester  to 
remember  that  each  method  involves  a  set  of  assumptions 
which  must  be  true  for  the  analysis  to  be  correct  (28:29). 
Hillier  and  Lieberman  also  recommend  using  standard 
statistical  tests  if  the  data  exists  for  comparisons.  If 
data  doesn't  exist  they  recommend  face  value  tests  but  add 
the  following  ideas: 

1)  Use  a  field  test  to  collect  data,  if 
possible . 

2)  Use  experts  to  look  at  the  sensitivity  of 
the  model  in  a  variety  of  scenarios. 

The  problem  with  the  first  method  is  that  it  is  often 
expensive  and  time  consuming  and  the  system  may  not  be 
available  or  easily  duplicated.  The  second  method  can  be 
valuable  because,  even  if  conclusions  about  a  single 
scenario  are  weak,  some  things  about  changes  in  results 
between  scenarios  may  be  Important  (17:809-810).  Lee, 

Moore,  and  Taylor  believe  that  the  major  difficulty  is 
validation  of  the  model.  First,  they  recommend  checking  the 
algorithm  to  be  sure  it  is  correctly  coded  to  avoid  the 
garbage  in  -  garbage  out  problem.  Then  they  recommend 
running  the  model  for  short  periods  of  time  and  comparing 
these  results  with  hand-calculated  ones.  They  also 
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recommend  breaking  the  model  into  modules  for  testing.  To 
aid  Initial  testing  they  recommend  simplifying  complex 
relationships  such  as  changing  stochastic  relationships  to 
deterministic  ones.  Finally,  recognizing  the  difficulties 
associated  with  this,  they  recommend  comparing  the  model 
with  the  real  world.  They  also  warn  the  tester  of  problems 
with  the  statistical  assumptions  necessary  and  of  problems 
with  the  covariance  that  sometimes  exists  in  simulation 
models  over  time  (18:486).  Starting  conditions  should  also 
be  checked  and  important  steady  state  conditions,  if  they 
exist,  should  be  analyzed  to  prevent  output  bias  (18:487). 
Although  most  authors  recommend  using  past  performance  of 
the  real  world  situation  as  a  guide,  Prltsker  warns  the 
tester  to  remember  that  past  performance  is  only  one  sample 
point  and  not  the  exact  answer  (23:12).  Testing  suffers 
from  three  common  research  problems:  1)  small  sample  size 
due  to  high  cost,  2)  aggregated  data,  and  3)  data  with 
questionable  validity  (28:30). 

Torn  provides  a  method  for  easily  modeling  simulation 
designs  and  then  validating  them.  This  method  uses  Petri 
nets  with  extensions  called  simulation  nets.  Petri  net 
theory  is  well  established  and  has  been  in  use  since  1962 
(31:71).  Torn  lists  the  following  advantages  to  using 
simulation  nets: 


1)  The  tool  is  based  on  the  widely  used  Petri 


2)  Petri  nets  are  well  suited  for  describing 
asynchronous  concurrent  processes. 

3)  Petri  nets  are  theoretically  well  founded. 

4)  The  tool  is  simple  and  easy  to  learn. 

5)  Both  top-down  design  and  independent  modeling 
(including  validation)  of  different  aspects  is  possib?e. 

6)  The  tool  is  user-friendly,  computer  programming 
is  avoided  and  the  whole  effort  is  devoted  to  modeling 
(31:71). 

This  simulation  net  method  does  not  describe  how  the 
simulation  should  be  performed  but  describes  only  the  model 
itself.  Because  of  this  non-procedural  method,  results  are 
calculated  much  more  quickly  than  when  using  a  method  that 
requires  programming  (31:71).  Finally,  Torn  discusses  the 
advantages  of  simulation  nets  in  validating  simulation 
designs.  He  points  out  that  this  method  is  well-founded  and 
especially  built  for  describing  parallel  processes.  The 
technique  has  only  a  few  modeling  pieces  and  therefore  is 
easy  to  learn  and  use.  Also,  the  model  allows  independent 
design  of  each  module.  Because  of  the  rigid  Petri  net 
format,  the  modeler  can  be  confident  in  his  model  flow  and 
testing  the  model  becomes  easy  and  efficient.  This  is  due, 
primarily,  to  the  fact  that  direct  use  of  the  nets  allows 
checking  of  the  simulation  without  having  to  write  a 
computer  program  first.  Torn  also  suggests  that  more 
research  should  be  done  in  this  area  (31:75). 


Although  simulation  models  are  simplifications  of  their 
real  world  counterparts,  they  can  still  be  extremely 
complex,  difficult  to  work  with,  and  expensive  to  use. 
Because  the  simulation  model  may  still  be  complex,  L. 
Friedman  and  H.  Friedman  suggest  the  use  of  a  metamodel. 

This  simpler  model  would  be  used  to  aid  understanding  of  the 
more  complex  model.  They  provide  several  examples  of  fields 
in  which  metamodels  have  been  used  to  help  interpret  more 
complex  models.  These  metamodels  are  especially  useful  in 
performing  sensitivity  analysis  and  answering  what-if 
questions  because  they  don't  use  a  computer;  this  can  save 
time  and  money.  One  example  of  a  metamodel  is  the  well 
known  regression  model  (11:144). 

Since  the  metamodel  is  two  levels  from  reality,  the 
authors  stress  the  importance  of  validating  the  metamodel 
both  to  the  simulation  model  and  to  the  real  world.  To 
validate  the  metamodel  the  authors  give  two  techniques.  The 
first  involves  randomly  dividing  the  simulation  data  into 
thirds.  The  first  two-thirds  will  be  used  to  build  a  second 
regression  model.  The  remaining  third  of  the  data  is  used 
to  test  this  regression  model.  If  the  R-squared  value  (a 
measure  of  model  fit)  from  the  test  data  is  small,  the  model 
does  not  explain  the  variation  in  the  data  very  well  and 
this  indicates  a  lack  of  predictive  ability  to  be  a  useful 
model  (11:145).  The  second  technique  is  called  double 
cross-validation.  The  simulation  data  is  split  in  half  and 


a  model  Is  developed  for  each  half  of  the  data.  Then  the 
opposite  half  of  the  data  is  used  to  test  each  model.  This 
provides  four  R-squared  values.  These  values  are  then 
compared  for  consistency.  Large  variations  in  values  imply 
that  the  metamodel  is  probably  invalid.  In  addition,  the 
coefficients  of  each  model  should  also  be  compared.  If 
large  differences  exist  between  the  models  especially  with 
respect  to  the  coefficient's  signs,  then  the  metamodel  may 
be  inconsistent  (11:145-6).  Finally,  the  authors  stress  the 
need  to  test  the  predictive  ability  of  the  metamodel  against 
the  real  world  because  this  is  the  final  test  of  any  model. 
The  metamodel  should  not  only  fit  the  simulation  model  but 
the  real  world  too  (11:146). 

In  conclusion,  Hillier  and  Lieberman  stress  that  the 
most  important  thing  is  to  convince  the  decision  maker  of 
the  model's  validity  so  that  he  will  use  the  results  to  aid 
his  decisions  (16:809). 

The  question  of  validation  is  thus  two-faced: 
determining  that  the  model  behaves  in  the  same  fashion 
as  the  real  life  system;  validating  that  inferences 
drawn  from  the  experiments  with  the  model  are  valid  or 
correct.  In  concept,  both  these  points  resolve 
themselves  to  the  standard  decision  problem  of 
balancing  the  cost  of  each  action  against  the  value  of 
the  increased  information  and  the  consequences  of 
erroneous  conclusions  [28:30]. 


Other  Models 


Several  models  which  address  aircraft  maintenance  and 
logistics  problems  are  available.  This,  however,  does  not 
negate  the  importance  of  this  thesis  effort  because  models 
of  the  same  reality  often  occur  as  a  result  of  the  object 
modeled,  questions  asked,  and  the  decisions  affected 
(29:212).  The  following  is  a  short  description  of  some  of 
the  models  available.  The  Expected  Value-Based  Logistics 
Capability  Assessment  Model  (ELCAM)  is  a  model  being  built 
at  the  Air  Force  Logistics  Management  Center  for  assessing 
logistics  capabilities .  It  is  not  meant  to  replace  any  of 
the  current  mainframe  models  such  as  the  Logistics  Composite 
Model  ( LCOM ) ,  Theatre  Simulation  of  Airbase  Resources 
(TSAR),  TSAR  Inputs  using  Airbase  Damage  Assessment 
(TSARINA),  or  Dyna-METRIC  models,  but  as  a  supplement  to  the 
current  methods  being  used.  Considered  a  first  order 
approximation,  the  documentation  clearly  states  that  the 
purpose  of  the  model  is  to  give  the  logistics  manager  an 
easy-to-use  tool  for  trade-off  and  sensitivity  analysis. 

The  model  is  not  meant  to  be  an  in-depth  logistics  analysis 
tool  (2:1).  The  model  is  not  a  simulation  but  an 
expected-value-based  model.  As  such,  it  lacks  some  of  the 
dynamic  nature  of  a  simulation  (2:10).  The  key  to  the  model 
is  determining  the  expected  value  of  downtime  for  an 
aircraft.  If  the  model  can  accurately  do  this,  the  theory 


is  supported  (2:3).  Although  the  model  is  not  a  Dyna-METRIC 
emulation,  it  does  use  some  mathematic  techniques  from 
Dyna-METRIC  such  as  those  used  to  calculate  the  number  of 
pipeline  spares  (2:5).  One  model  drawback  is  that  it  also 
bases  failures  on  scheduled  flying  hours  rather  than  actual 
flying  hours,  but  work  is  being  done  to  address  this 
limitation  (2:10).  The  model  is  far  from  its  final  form  and 
has  a  number  of  limiting  assumptions  but  it  wasn't  meant  to 
be  an  in-depth  analysis  tool.  It  is  written  in  Basic  for 
the  Z-100  or  the  Z-248.  Testing  with  small  sample  data 
bases  from  TSAR  has  given  promising  results  (2:7). 

BDM  has  built  a  model  known  as  the 
Availability/Readiness  Model  for  the  Personal  Computer 
(ARM-PC)  (4).  The  uses  of  the  model  include  specification 
requirements  evaluation,  design  influence,  design 
assessment,  and  general  management  assistance.  The  model  is 
a  stochastic  network  model  in  SLAM  II  and  runs  on  a 
micro-computer.  It  was  built  to  simulate  a  generic  aircraft 
operation  and  maintenance  environment.  Although  maintenance 
is  at  the  LRU-level,  output  is  aggregated  to  the  subsystem 
level.  It  is  a  generic  aircraft  logistics  model  owned  by 
BDM  and  not  meant  as  a  Dyna-METRICS  emulation  package.  It 
is  meant  primarily  for  assessing  design  change  impacts  and 
what-if  analysis  (4). 

The  Aircraft  Subsystem  Availability  Model  (ASAM), 
developed  by  Headquarters  Air  Force  Operational  Test  and 


Evaluation  Center  is  designed  to  estimate  an  aircraft 
subsystem’s  performance  (1).  The  model  does  this  by 
estimating  the  subsystem  availability  in  terms  of 
mission-capable  rate.  Able  to  calculate  the  subsystem 
downtime  at  both  the  organizational  and  Intermediate 
maintenance  level,  the  model  also  estimates  the  impacts  of 
manpower  and  resource  constraints  on  the  subsystem 
availability.  The  model  supports  both  peacetime  and  wartime 
scenarios  (1:2).  The  model,  however,  has  a  number  of 
limitations.  First,  the  model  only  looks  at  one  subsystem 
and  aggregates  the  rest  of  the  aircraft.  Also,  the 
subsystem  is  limited  to  only  20  LRU's.  Another  problem  is 
that  the  model  cannot  handle  multiple  LRU  failures.  The 
model  has  a  fixed  aircraft  squadron  size  and  a  scenario  of 
one  year  of  peacetime  operation  (20  sorties/day) .  No  combat 
or  weather  losses  are  included.  Maintenance  times  in  the 
model  use  a  lognormal  distribution  (1:2).  The  model  is 
built  in  SLAM  II  and  runs  on  a  Z-248.  HQ  TAC  has  validated 
the  model  logic  and  input  variables  (1:6). 

Coconst  Wacriflg 

Dyna-METRIC  has  been  plagued  by  a  problem  common  to 
many  models  ( ie .  validation).  Because  of  a  lack  of 
supporting  data,  Dyna-METRIC  has  had  problems  gaining 
acceptance  as  a  requirements  builder.  In  an  attempt  to 


remedy  this  problem,  HQ  TAC  has  performed  an  exercise  to 
provide  data  for  a  Dyna-METRIC  validation.  This  exercise 
took  place  in  the  summer  of  1987  using  an  F-15  squadron 
which  was  temporarily  isolated  from  the  rest  of  the  base. 

The  object  of  the  test  was  to  simulate  a  deployed  unit  with 
limited  manpower,  equipment  and  resources.  The  unit  was 
tasked  to  fly  realistic  combat  sortie  rates  for  30  days. 

Data  was  collected  on  everything  that  was  done  during  the 
test.  This  data  would  later  be  used  in  the  Dyna-METRIC 
model  to  see  how  well  the  model  predicted  reality.  Then,  if 
necessary,  changes  would  be  made  to  improve  Dyna-METRICS . 
Because  this  thesis  effort  attempts  to  emulate  the 
Dyna-METRIC  model,  the  results  of  this  exercise  are 
important  for  comparison  with  the  Dyna-METRIC  results  and 
for  comparison  to  the  real  world.  Several  important 
discoveries  were  made  during  the  test  including: 

1)  Demand  for  parts  was  lower  than  predicted. 

2)  Parts  were  fixed  faster  and  more  reliably 
than  predicted. 

3)  Personnel  adapted  and  performed  better 
than  predicted.  (7) 

Figure  2  shows  the  number  of  demands  predicted  by 
Dyna-METRICS  and  the  actual  exercise  demand.  The  Figure 
also  shows  the  initial  number  of  WRSK  parts  available  and 
the  number  remaining  at  the  end  of  the  exercise,  predicted 
and  actual.  The  deployed  unit  contained  only  71%  of  the 
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standard  Air  Force  WRSK.  This  was  not  by  design  but  merely 
what  the  unit  had  In  stock  at  the  time  of  testing.  As  a 
result,  no  conclusions  should  be  drawn  about  the  choice  of 
this  particular  set  of  WRSK  spares.  Another  choice  of  71% 
of  the  WRSK  could  result  in  a  better  or  worse  overall 
performance.  Coronet  Warrior  was  used  to  compare  real  world 
performance  with  the  Dyna-METRIC  predictions  and  not  to 
assess  this  WRSK  composition. 

NUMBER  OF  PARTS 
(AIRCRAFT  ONLY) 


WRSK  AUTHORIZATIONS  (100%)  3094 

STARTING  WRSK  INVENTORY  (71%)  2187 

PREDICTED  ACTUAL 

DEMANDS  2162  946 

ISSUES  1690  772 

BALANCE  (WITHOUT  REPAIR)  497  1415 


Figure  2.  WRSK  Demands 

(Reprinted  from  7) 

The  next  figure  gives  a  break  out  by  day  of  the  sorties 
tasked,  the  actual  sorties  flown,  and  the  number  of  sorties 
predicted  by  the  model. 
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Figure  3.  Sortie  Performance 

(Reprinted  from  7) 


Figure  4  shows  the  number  of  fully  mission-capable  aircraft 
by  day  both  actual  and  predicted  against  the  TAC  fully 
mission-capable  goal  with  100%  of  the  WRSK. 
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Figure  4.  FMC  Aircraft  Performance 

(Reprinted  from  7) 


Innovation  was  a  key  driver  in  the  results  shown.  For 


example,  repair  capability  was  better  than  predicted.  The 


exercise  also  affirmed  some  optimistic  model  assumptions 


such  as  those  involving  the  avionics  intermediate  repair 


shop  productivity  and  cannibalization  effectiveness  (7).  A 


number  of  conclusions  from  this  study  are  important  to  this 


work.  First,  the  study  concluded  that  the  basic  mechanics 


of  Dyna-METRIC  were  sound.  The  demand  and  repair  databases. 


however,  need  attention.  Also,  the  ease  of  maintenance  and 


cannibalization  repair  times  should  have  more  emphasis  when 


setting  stock  levels.  The  study  also  concluded  that  a 


better  and  probably  cheaper  F-15  WRSK  could  be  built 


Finally,  a  similar  exercise  in  1988  was  recommended  for  the 


F-16  and  continued  use  of  Dyna-METRIC  for  sparing 
requirements  was  affirmed  (7). 


The  overall  approach  can  be  broken  into  several  areas 
to  include  data  gathering,  model  development  and  validation, 
and  a  data  analysis  plan.  Basically,  the  research  will 
identify  shortfalls  of  the  TAC  Dyna-METRIC  model  and  then 
find  a  software  package  that  will  emulate  Dyna-METRIC.  In 
addition,  the  model  will  also  be  capable  of  addressing  some 
of  the  present  limitations  of  Dyna-METRIC.  The  approach  in 
each  area  will  now  be  covered. 

Data  gathering  is  required  in  a  number  of  areas.  HQ 
TAC/LGY  will  provide  their  expertise  in  assessing  the 
capabilities  and  shortfalls  of  the  present  model.  HQ 
TAC/LGY  will  provide  other  data  to  include  the  input  format 
and  actual  data  from  the  Dyna-METRIC  model  providing  the 
baseline  input  for  the  thesis.  They  will  also  provide 
requirements  for  the  model  output  format.  In  searching  for 
a  suitable  microcomputer  language,  current  literature  will 
be  reviewed.  As  a  part  of  this  effort,  HQ  TAC/LGY  will 
provide  guidelines  for  hardware  and  software  needs.  Using 
the  standard  input  data  base  mentioned  earlier,  HQ  TAC/LGY 
will  provide  computer  runs  of  Dyna-METRIC.  The  output  from 
these  runs  will  be  necessary  for  comparison  with  the 
modeling  effort.  Also,  HQ  TAC/LGY  will  provide  the  results 
of  the  Coronet  Warrior  exercise  to  Include  maintenance  data. 


exercise  performance  data,  and  output  from  a  Dyna-METRIC 
run.  The  maintenance  data  will  include  demand  rates,  not 
repairable  this  station  rates,  quantity  per  application 
figures,  repair  cycle  times  and  levels  of  indenture.  A  list 
of  five  parts  with  their  individual  repair  cycle  times 
should  be  included.  The  exercise  data  and  Dyna-METRIC 
output  should  include  the  number  of  sorties  and  the  number 
of  fully  mission-capable  aircraft.  Any  deviations  from  the 
scenario  or  from  the  Dyna-METRIC  model  assumptions  should  be 
mentioned.  This  data  gathering  will  provide  information  for 
the  model  development  and  data  analysis  portions  of  the 
study. 

Model  development  and  validation  consists  of  a  number 
of  steps.  First,  the  problem  must  be  clearly  defined.  This 
should  be  done  with  a  thorough  literature  review  and  HQ 
TAC/LGY  user  input.  With  this  information  and  an 
appropriate  software  package,  a  model  flow  to  emulate 
Dyna-METRIC  will  be  developed.  This  outline  will  be  written 
with  the  technical  advice  and  approval  of  TAC.  When  the 
model  flow  is  completed  and  approved,  it  will  be  coded  and 
executed . 

The  model  will  be  broken  into  three  areas:  the 
scheduling  module,  the  sortie  generation  module,  and  the 
repair  module.  The  scheduling  module  will  be  constructed  as 
follows.  Each  day  a  daily  flight  schedule  will  be  generated 
consisting  of  the  sortie  generation  rate  and  sortie  duration 
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tine.  The  number  of  sorties  flown  that  day  In  the  model  is 
set  to  zero.  The  number  of  fully  mission-capable  aircraft 
is  counted  and  stored.  Then  the  daily  sortie  requirement  is 
calculated.  In  Dyna-METRIC,  daily  sortie  requirements  are 
calculated  by  multipling  the  number  of  aircraft  initially 
deployed  by  the  required  daily  sortie  generation  rate. 

These  requirements  are  not  affected  by  the  number  of 
aircraft  that  might  be  available  on  that  day.  Next,  the 
aircraft  hangar  is  opened  and  aircraft  are  allowed  to  begin 
flying  sorties.  At  the  end  of  the  day  the  aircraft  hangar 
is  closed  and  daily  flying  statistics  are  gathered.  The 
statistics  include  the  number  of  sorties  flown  and  the 
number  of  fully  mission-capable  aircraft  available. 

Although  Dyna-METRIC  only  counts  the  number  of  fully 
mission-capable  aircraft  at  the  end  of  each  day,  because  of 
the  dynamic  nature  of  the  simulation  model,  this  thesis 
calculates  a  daily  average  number  of  fully  mission-capable 
aircraft  (FMCA)  based  on  (1). 

I  PMC  aircraft  *  I  PMC  aircraft 
FMCA  -  beginning  of  dav  end  of  dav  (1) 

2 

This  basic  flow  repeats  Itself  for  each  day  of  the  30  day 
scenario. 

The  sortie  generation  module  will  be  built  as  follows. 


At  the  beginning  of  the  simulation,  the  number  of  deployed 
aircraft  will  be  generated.  As  part  of  this  generation  each 


aircraft  will  be  given  a  tail  number.  Also,  each  aircraft 
will  be  given  a  full  complement  of  line  replaceable  units 
(LRU)  and  placed  in  a  fully  mission-capable  status.  This 
assumption  is  also  made  at  the  beginning  of  the  Dyna-METRIC 
model.  The  aircraft  are  then  sent  to  fly  the  first  day's 
sorties.  Before  each  sortie  is  flown  a  number  of  conditions 
must  be  met.  First,  the  aircraft  must  be  capable  of 
finishing  the  sortie  before  the  end  of  the  day.  Although 
this  condition  is  also  true  in  Dyna-METRIC,  there  is  a 
slight  difference  because  this  thesis  only  allows  complete 
sorties  where  Dyna-METRIC,  because  it  is  deterministic, 
aggregates  partial  sorties  into  complete  ones.  Second,  if 
the  daily  sortie  goal  is  met,  the  aircraft  is  returned  to 
the  hangar.  This  is  identical  to  the  Dyna-METRIC  model 
which  doesn't  allow  sorties  to  be  flown  past  the  daily 
sortie  goal.  Finally,  if  the  sortie  goal  has  not  been  met, 
then  the  average  number  of  sorties  flown  by  each  aircraft 
for  that  day  is  checked.  The  aircraft  cannot  average  more 
sorties  per  day  than  the  maximum  sortie  generation  rate  of 
3.5.  If  this  average  is  exceeded,  the  aircraft  is  sent  to 
the  hangar.  Dyna-METRIC  has  the  same  restriction  but  again 
aggregates  this  over  all  aircraft  versus  doing  it  by 
individual  aircraft.  If  the  aircraft  is  not  sent  back  to 
the  hangar  it  is  ready  to  fly  a  sortie.  The  individual 
aircraft  sortie  rate  is  incremented  and  so  is  the  daily 
sortie  count.  Then  the  aircraft  begins  the  sortie.  When 


the  aircraft  finishes  the  sortie,  it  calculates  the  number 
of  demands  per  sortie.  Based  on  this  demand  rate,  a 
decision  is  made  as  to  whether  the  aircraft  is  broken  or 


not.  If  the  aircraft  is  broken,  it  is  sent  to  the  repair 
module.  If  it  is  not  broken,  the  aircraft  is  sent  back  to 
the  flight  line,  available  to  fly  again.  When  the  end  of 
the  day  is  reached  or  all  required  sorties  have  been  flown, 
the  aircraft  are  sent  to  wait  at  the  hangar  until  the  next 
day's  flying  begins.  At  the  beginning  of  the  next  day,  the 
individual  aircraft  sortie  rates  are  cleared  and  the 
aircraft  are  sent  to  fly  again. 

The  repair  module  is  constructed  as  follows.  When 
aircraft  come  from  the  flight  line,  the  time  between  failure 
is  collected  and  the  time  of  failure  is  noted.  The  aircraft 
then  waits  for  a  maintenance  man  and  test  stand.  In  the 
emulation  mode  this  is  an  infinite  resource  to  match  the 
assumption  made  in  Dyna-METRIC.  After  receiving  a 
maintenance  man,  the  aircraft  enters  the  repair  cycle.  To 
emulate  Dyna-METRICS,  the  repair  cycle  is  instantaneous 
unless  the  aircraft  must  wait  for  a  LRU.  This  part  of  the 
model  will  be  flexible  to  allow  insertion  of  realistic 
repair  times  for  such  things  as  remove  and  replace  times, 
trouble  shooting  times,  and  transportation  times.  This  is 
in  addition  to  the  parts  waiting  times  that  are  already 
included  in  the  model.  The  actual  repair  cycle  begins  by 
calculating  what  portion  of  the  breaks  are  due  to  the 


selected  LRUs  and  what  portion  are  due  to  the  rest  of  the 
aircraft.  When  this  is  done,  a  series  of  random  draws  are 
made  and  based  on  these  draws  the  number  and  locations  of 
the  breaks  are  determined.  If  none  of  the  selected  LRUs  are 
chosen,  the  aircraft  is  sent  to  the  generic  aircraft  repair 
cycle.  In  this  generic  cycle,  some  proportion  of  the 
aircraft  wait  an  average  repair  cycle  time  and  then  are  sent 
to  the  flight  line.  This  proportional  split  is  set  by  the 
user  based  experience.  Those  that  don’t  wait  are  sent 
back  to  the  flight  line  immediately.  Before  returning  to 
the  flight  line  each  aircraft  releases  its  maintenance 
resources.  Those  aircraft  that  have  failures  in  both  the 
selected  LRUs  and  the  generic  aircraft  LRUs  proceed  as  if 
they  only  had  broken  selected  LRUs  because  the  broken 
selected  LRUs  are  considered  the  critical  assets.  The 
aircraft  with  broken  selected  LRUs  are  sent  to  the  selected 
LRU  repair  cycle.  In  the  selected  LRU  repair  cycle,  the 
broken  LRU  is  removed  and  sent  to  the  intermediate  level 
repair  cycle.  Then,  based  on  whether  cannibalization  is 
allowed  or  not,  the  path  splits.  If  cannibalization  is  not 
allowed,  the  maintenance  resources  are  released  and  the 
aircraft  waits  for  parts.  When  the  parts  become  available, 
the  aircraft  gets  a  maintenance  asset  and  is  repaired.  Then 
the  aircraft  releases  the  maintenance  assets,  reports  time 
in  repair,  and  returns  to  the  flight  line.  If 
cannibalization  Is  allowed,  the  broken  LRU  stock  level  is 


checked  to  see  if  parts  are  available.  If  they  are,  the 
aircraft  is  repaired  and  sent  back  to  the  flight  line  after 
releasing  the  maintenance  assets  and  collecting  time  in 
repair.  If  the  broken  LRU  is  not  available,  the  aircraft  is 
disassembled  and  its  parts  are  added  to  the  available  stock 
levels.  The  maintenance  assets  are  also  released  for  other 
uses.  When  parts  become  available,  either  from  another 
aircraft  or  the  intermediate  level  repair  cycle,  the 
aircraft  waits  for  maintenance  assets,  is  assembled,  and 
returned  to  the  flight  line  after  releasing  the  maintenance 
assets  and  noting  the  time  in  the  repair  cycle. 

The  LRUs  sent  to  the  intermediate  level  repair  cycle 
proceed  as  follows.  Arriving  LRUs  are  split  by  their  not 
repairable  this  station  (NRTS }  rates.  Those  not  repairable 
are  not  released  back  to  the  available  stock.  Those  LRUs 
that  are  repairable  are  separated  based  on  whether  they  have 
selected  SRUs  or  not.  If  they  don't  have  any  selected  SRUs 
they  are  sent  on  to  be  repaired.  If  they  have  selected 
SRUs,  then  a  random  draw  is  made  and  the  broken  SRU  is 
chosen.  If  no  SRU  is  chosen  or  the  SRU  is  available  in 
stock,  the  LRU  is  sent  to  be  repaired.  If  no  SRU  is 
available,  the  LRU  is  disassembled  and  its  SRUs  are  made 
available  to  other  LRUs.  When  the  LRUs  are  sent  to  be 
repaired,  their  repair  time  is  based  on  a  random  draw  from 
an  exponential  distribution  using  the  repair  cycle  time  as 


the  mean  parameter.  After  completing  the  repair,  the  LRU  is 
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sent  back  to  the  supply  stock.  No  SRU  repair  capability 
exists  at  the  unit  level. 

The  following  is  a  description  of  how  the  model  chooses 
a  broken  selected  LRU  and  SRU.  When  the  selected  LRUs  or 
SRUs  are  read  from  the  input  file,  the  individual  demand 
rate  is  multiplied  by  the  quantity  per  aircraft  for  each 
part  and  these  values  are  summed.  Each  part's  proportion  of 
the  total  demand  rate  is  also  calculated.  This  sets  up  a 
continuous  distribution  of  demand  fractions  between  zero  and 
one.  Then,  when  a  part  fails,  a  random  draw  between  zero 
and  one  is  made.  This  draw  is  compared  to  the  zero-one 
distribution  of  demand  rates.  The  interval  where  that  draw 
falls  determines  the  broken  part.  This  method  allows 
multiple  duplicate  failures  and  parallel  processing  of 
broken  LRUs  or  SRUs. 

The  Dyna-METRIC  model  uses  an  exponential  distribution 
for  repair  times.  Questions  have  been  raised  as  to  whether 
this  is  a  reasonable  assumption.  The  ASAM  model  mentioned 
in  Chapter  Two,  for  example,  uses  a  lognormal  distribution 
for  repair  times.  In  order  to  study  this  assumption  more 
closely,  five  LRUs  with  multiple  repair  times  will  be  chosen 
for  testing  from  the  Coronet  Warrior  exercise.  These  repair 
times  will  form  the  input  data  files  to  be  used  with  the  AID 
package  built  by  Pritsker  and  Associates.  The  repair  data 
will  be  tested  for  goodness  of  fit  with  the  lognormal  and 
exponential  distributions.  Using  both  the  chi-square  and 


Kolmogorov-Smirnov  tests,  runs  will  be  made  at  the  95% 
significance  level  and  the  results  will  be  reported.  The 
data  analysis  plan  flows  out  of  the  above  model  development 
and  testing. 

The  data  analysis  plan  revolves  around  the  choice  of 
software  packages  and  the  two  groups  of  test  runs.  The 
choice  of  software  packages  will  be  based  on  user 
requirements  and  the  availabilty  of  the  software.  User 
criteria  will  be  rank-ordered.  The  package  that  is 
available  and  satisfies  the  most  critical  criteria  will  be 
used . 

To  use  this  model  properly,  a  number  of  steps  should  be 
followed.  The  first  step  is  to  check  the  model  assumptions 
and  scenario  to  Insure  that  these  are  appropriate  for  the 
present  application.  The  following  scenario  applies  to  this 
model.  It  closely  follows  the  Dyna-METRIC  model  scenario. 
The  model  calls  for  a  30  day  deployment.  Although  the 
flight  schedule  can  be  changed,  for  the  runs  in  this  thesis, 
the  first  seven  days  have  a  requirement  of  2.3  sorties  per 
aircraft  per  day  and  a  sortie  duration  of  1.8  hours.  From 
day  eight  to  day  thirty,  the  number  of  sorties  per  aircraft 
per  day  is  1.1  and  the  sortie  duration  is  still  1.8  hours. 
These  flight  requirements  were  provided  by  HQ  TAC/LGY. 
Because  of  SLAM  PC  limitations,  there  are  also  limits  on  the 
number  of  LRUs  and  SRUs  that  can  be  modeled.  The  model 
allows  the  modeling  of  40  separate  LRUs.  Those  LRUs  that 


are  not  explicitly  modeled  as  a  resource  will  be  combined 
into  one  aircraft  unit  which  will  fall  based  on  the  combined 
demand  rate  of  all  the  LRUs  included  in  this  aircraft  unit. 
The  portion  of  downtime  associated  with  an  aircraft  unit 
failure  will  be  the  weighted  average  repair  cycle  time  of 
all  the  LRUs  included.  The  percentage  of  aircraft  unit 
failures  which  actually  cause  model  downtime  will  be  set  by 
the  user  based  on  experience.  For  this  work  the  downtime 
percentage  will  be  2.5%  for  the  TAC  sample  data  and  1.25% 
for  the  Coronet  Warrior  data.  The  reason  for  the  difference 
is  that  the  TAC  sample  data  has  a  much  larger  set  of  LRUs 
that  are  aggregated  in  the  aircraft  than  the  Coronet  Warrior 
data  does.  LRUs  that  are  modeled  separately  will  use  their 
own  individual  repair  cycle  times  and  will  cause  downtime 
only  when  a  3pare  LRU  is  not  available  for  replacement.  The 
number  of  SRUs  is  limited  to  30.  Any  SRU  not  being  modeled 
is  assumed  to  be  available  in  sufficient  quantity  to  meet 
anticipated  demand  (i.e.  not  a  logistics  driver).  The  model 
makes  a  number  of  assumptions  in  order  to  emulate  the 
Dyna-METRIC  model.  The  following  assumptions  are  important. 
First,  100%  cannibalization  is  not  only  assumed  but  all 
cannibalizat ions  are  considered  successful  and 
instantaneous.  Every  LRU  is  considered  mission  essential 
and  equally  important  for  maintenance.  Maintenance  is 
unconstrained.  No  resupply  is  allowed  during  the  30  day 
deployment  and  since  this  model  is  only  at  the  squadron 


level,  parts  which  are  not  repairable  this  station  (NRTS ) 
become  unavailable  for  the  rest  of  the  deployment.  Finally, 
the  model  doesn't  allow  attrition  (20:19.25).  Although 
Dyna-METRIC  only  looks  at  problem  LRUs,  this  model  will  look 
at  both  LRUs  and  SRUs .  The  SLAM  model  being  built  will  also 
be  flexible  enough  that  all  of  the  above  assumptions  will  be 
capable  of  being  made  more  flexible.  For  example,  the  model 
has  the  capability  to  constrain  maintenance  and  give 
individual  LRU  cannibalization/no  cannibalization  flags  with 
cannibalization  delays.  The  following  assumptions  are  also 
made : 

-  The  demand  process  is  poisson. 

-  The  demand  process  is  independent  of  the 
repair  process. 

-  The  repair  process  uses  times  drawn  from  an 
exponential  distribution  with  a  given  mean 
repair  cycle  time  (20:4.6). 

One  assumption  that  is  not  in  Dyna-METRIC  but  is  in  this 
model  is  that  no  more  than  two  failures  are  allowed  per 
sortie  (i.e.  the  total  aircraft  demand  rate  per  flying  hour 
times  the  sortie  duration  cannot  be  larger  than  two).  This 
is  not  considered  restrictive  since  the  demand  data  provided 
has  been  well  below  this  restriction. 

Validation  and  verification  is  very  important. 
Verification  is  showing  that  the  model  behaves  as  intended 
(9:11).  To  show  this,  Capt.  Moulder,  another  graduate 


student,  will  take  the  logic  flow  diagrams  and  list  of 
variables  and  compare  them  to  the  written  code.  If  any 
discrepancies  are  found,  they  will  be  noted  and  corrected. 
This  process  will  continue  iteratively  until  the  model  logi 
matches  the  written  code.  Model  validation,  which  is 
building  the  user’s  confidence  to  an  acceptable  level,  will 
involve  a  number  of  steps  (28:33).  These  steps  include 
checking  the  face  value  and  assumptions  of  the  model  and 
testing  the  input-output  transformations  of  the  model 
against  the  sample  input  and  output  provided  by  TAC  and  the 
input-output  transformation  from  the  Coronet  Warrior 
exercise.  The  face  value  testing  will  be  an  iterative 
process  where  the  model  flow  is  built,  showed  to  the  user, 
changes  made,  and  then  showed  to  the  user  again.  When  the 
user  is  satisfied  that  the  model  flow  and  assumptions  match 
the  Dyna-METRIC  model  in  sufficient  detail,  the  face  value 
testing  is  complete.  The  testing  of  the  input-output 
transformations  will  be  more  difficult.  Each  comparison 
test  will  be  run  in  a  similar  way  (ie.  model  vs.  TAC  data 
and  model  vs.  Coronet  Warrior  data). 

Two  model  outputs  will  be  tested.  The  first  will  be 
the  average  sorties  generated.  The  second  will  be  the 
average  number  of  f ully-miss ion  capable  aircraft.  Because 
there  are  two  output  parameters  of  interest,  a  technique  to 
compare  the  two  parameters  simultaneously  is  needed.  In 
addition,  the  output  varies  between  days.  In  order  to  do 


this,  the  following  method  will  be  used.  TAC  has  set  the 
standard  deviation  of  the  test  runs  at  one  aircraft  per  day 
and  1.25  sorties  per  day.  A  pilot  sample  of  five  runs  will 
be  taken.  Based  on  this  sample  the  appropriate  number  of 
runs  will  be  calculated  to  get  the  desired  accuracy.  The 
model  will  then  be  rerun  to  achieve  the  desired  accuracy. 

The  output  from  these  runs  will  be  averaged  for  each  day  of 
the  deployment.  These  daily  averages  will  be  subtracted 
from  the  Dyna-METRIC  expected-value  daily  averages.  The 
differences  will  then  form  the  database  for  a  two-sided 
hypothesis  test  using  the  normal  statistic.  The  null 
hypothesis  will  be  that  the  difference  in  model  means  equals 
zero  while  the  alternate  hypothesis  will  be  that  the 
difference  in  means  does  not  equal  zero.  Each  test  will  use 
a  95%  significance  level.  For  the  model  to  be  accepted,  the 
test  should  not  reject  the  null  hypothesis.  Conclusions 
will  be  made  as  to  why  differences  do  or  do  not  exist. 


Ll.  results 


The  £lrst  task  mentioned  in  Chapter  Three  is  to 
Identify  capabilities  and  limitations  of  the  Dyna-METRIC 
model.  Some  of  these  capabilities  and  limitations  have 
already  been  mentioned  in  Chapter  One  in  reference  to  the 
problem  background  and  research  objectives.  Additional 
capabilities  and  limitations  were  mentioned  in  Chapter  Two 
in  the  Dyna-METRIC  section.  For  example,  one  capability  of 
the  Dyna-METRIC  model  is  its  flexibility  as  a  tool  for 
analyzing  the  impact  of  logistics  sparing  on  aircraft 
capability  (15:1).  Limitations  such  as  unconstrained 
maintenance  and  unlimited  Depot  supply  are  also  mentioned 
(15:1).  Assumptions  and  limitations  are  summarized  in 
Appendix  C. 

HQ  TAC  has  provided  a  number  of  important  data  items. 
The  first  is  an  input  data  set  for  the  F-15B  which  is  being 
used  at  HQ  TAC.  Along  with  this  input  file,  HQ  TAC  provided 
a  sample  Dyna-METRIC  output  using  this  input  data.  Only  one 
run  of  the  model  is  necessary  because  of  the  deterministic 
nature  of  Dyna-METRIC.  In  addition,  they  provided  similar 
input  and  output  files  for  the  Coronet  Warrior  exercise. 

Due  to  the  length  and  complexity  of  these  data  sets,  only 
the  most  important  portions  have  been  included  in  this 
thesis.  They  can  be  found  in  Appendix  D.  The  content  of 


these  data  sets  are  explained  in  this  Appendix.  For  copies 
of  the  complete  input  and  output  files  contact  HQ  TAC/LGY. 

The  next  task  was  to  identify  hardware  and  software 
needs,  prioritize  these  needs,  collect  information  on 
hardware  and  software  availability  and  then  choose  an 
appropriate  package  for  use.  HQ  TAC  identified  a  number  of 
system  requirements.  The  hardware  requirements  include  the 
capability  to  run  on  a  Z-248  with  640K  RAM,  a  single  floppy 
disk,  a  single,  10MB  hard  disk  and  a  wide  carriage  dot 
matrix  printer.  This  should  be  done  with  minimum  additional 
investment  in  hardware  (15:3).  The  software  package  should 
be  economical,  capable  of  emulating  Dyna-METRIC  with 
execution  times  of  less  than  2  hours,  and  capable  of  looking 
at  50  to  100  problem  items.  It  should  also  have  graphics 
modification  capability.  Several  restrictions  were  also 
placed  on  the  choice  because  of  the  thesis  requirements. 

For  example,  the  software  must  be  readily  available  to  the 
author  and  either  easily  learned  or  already  known  by  him 
because  of  the  short  time  allotted  for  the  thesis  effort. 

In  accessing  the  available  software,  the  information  in 
Chapter  Two  under  Microcomputers  provided  the  primary  basis 
for  comparison.  Based  on  the  above  considerations, 
especially  availability  of  software,  cost,  wide-spread  usage 
and  acceptance  of  the  language  and  knowledge  of  the  language 
by  this  author,  HQ  TAC  chose  and  supplied  SLAM  II  PC  as  the 
model  development  software. 


In  developing  the  model  and  testing  it,  HQ  TAC 
identified  two  key  output  parameters  of  interest.  They  were 
the  number  of  sorties  flown  per  day  and  the  number  of  fully 
mission-capable  aircraft  available  (5). 

Before  discussing  the  specific  results  of  the  testing, 
the  reader  is  again  reminded  of  the  assumptions  and 
limitations  of  both  Dyna-METRIC  and  this  thesis  model. 

These  assumptions  were  discussed  in  Chapter  Three.  Also  a 
summary  is  given  in  Appendix  C  for  reference. 

The  Coronet  Warrior  exercise  was  discussed  in  Chapter 
Two.  The  important  results  were  as  follows: 

1)  Demand  for  parts  was  lower  than  predicted. 

2)  Parts  were  fixed  faster  and  more  reliably 
than  predicted. 

3)  Personnel  adapted  and  performed  better 
than  predicted. 

4)  Innovation  by  personnel  was  a  key  driver 
in  the  results. 

5)  Optimistic  model  assumptions  were  affirmed 
including: 

-  avionics  intermediate  repair  shop 
productivity . 

-  cannibalization  effectiveness. 

6)  Basic  mechanics  of  Dyna-METRIC  are  sound. 

7)  Demand  and  repair  data  bases  need 


attent ion  ( 7 ) . 


r 


More  extensive  data  sets  and  results  are  available  from  HQ 
TAC.  The  Coronet  Warrior  input  and  Dyna-METRIC  output  files 
are  a  direct  result  of  this  exercise  (see  Appendix  D) . 

HQ  TAC  provided  five  sets  of  repair  times  for  testing 
repair  time  distributions.  These  times  can  be  found  in 
Appendix  E.  Two  types  of  goodness-of-f it  tests  were 
performed.  They  were  the  Chi-square  method  and  the 
Kolmogorov-Smirnov  (K-S)  method.  Since  the  K-S  method  is 
generally  accepted  as  more  powerful  only  the  results  from 
this  test  were  shown  here  (6:346) .  The  full  results  were 
given  in  Appendix  E.  The  null  hypothesis  for  these  tests 
was  that  they  were  either  exponentially  or  lognormally 
distributed.  The  alpha  level  was  set  at  0.05  or  a  95% 
confidence  level.  The  K-S  test  results  are  shown  in  Table 
3.  They  are  broken  out  by  data  set  and  distribution  type. 

Table  3.  Repair  Time  Distribution  Tests 


0.287  0.209  0.119 
0.234  0.129  0.096 
0.275  0.173  0.218 
0.203  0.151  0.095 
0.194  0.157  0.068 


NOTE:  ALPHA=0 . 0 5 


The  verification  effort  was  concluded  by  Capt.  Moulder 
on  November  16,  1987  when  model  flow  diagrams  and  SLAM  II 
coding  were  compared  for  discrepancies.  No  differences  were 


found.  The  flow  charts  and  the  SLAM  code  can  be  found  in 
Appendix  B.  A  description  of  the  basic  model  flow  can  be 
found  in  Chapter  Three.  The  model  code  also  has  internal 
documentat ion . 

Face-value  validation  took  place  through  a  number  of 
work  sessions  and  personal  Interviews  with  Capt.  Budde,  HQ 
TAC/LGY  and  Capt.  Mabe,  AFIT/LSMA  (5)  (21).  Final  agreement 
on  the  model  flow  took  place  at  a  meeting  on  30  September 
1987  with  Capt.  Budde  at  HQ  TAC.  This  model  flow  was  then 
implemented  in  SLAM  II.  The  approved  flow  is  the  previously 
mentioned  one  in  Appendix  B. 

Results  from  the  testing  of  input-output 
transformations  involved  a  number  of  steps.  First,  five 
pilot  runs  were  made  for  the  TAC  sample  and  Coronet  Warrior 
input  data.  Each  run  produces  one  data  point  for  each  day. 
Means  and  standard  deviations  for  each  day  were  calculated 
over  the  five  runs.  Tables  4  and  5  show  the  means  and 
standard  deviations  by  day  and  output  category.  Table  4  is 
for  the  TAC  sample  data  and  Table  5  is  for  the  Coronet 


Warrior  data. 


4.  Output  Variances  For  5  Runs  TAC  Sample  Data 


Table  5.  Output  Variances  For  5  Runs  Coronet  Warrior  Data 

OUTPUT 

SORTIE  EM£ 


DAY 

MEAN 

STD.  DEV. 

MEAN 

STD.  D 

1 

55.00 

0.00 

22.90 

0.19 

2 

55.00 

0.00 

21.00 

0.35 

3 

55.00 

0.00 

20.10 

0.51 

4 

55.00 

0 . 00 

20.20 

0.41 

5 

55.00 

0.00 

19.80 

0.68 

6 

55.00 

0.00 

19.20 

0.72 

7 

55.00 

0.00 

18.80 

0.58 

8 

26.00 

0.00 

18.40 

0.29 

9 

26.00 

0.00 

18.60 

0.29 

10 

26.00 

0 . 00 

19.00 

0.57 

11 

26.00 

0.00 

19.30 

0.80 

12 

26.00 

0.00 

19 . 50 

0.80 

13 

26.00 

0.00 

19.60 

0.83 

14 

26.00 

0.00 

19.50 

0.79 

15 

26.00 

0.00 

19.40 

0.68 

16 

26.00 

0.00 

19 . 30 

0.66 

17 

26.00 

0.00 

19.00 

0.76 

18 

26.00 

0.00 

18.50 

0.82 

19 

26.00 

0.00 

18.40 

0.83 

20 

26.00 

0.00 

18.50 

0.84 

21 

26.00 

0.00 

18.40 

0.66 

22 

26.00 

0.00 

18.30 

0.58 

23 

26.00 

0.00 

18.00 

0.76 

24 

26.00 

0.00 

17.70 

0.86 

25 

26.00 

0.00 

17.30 

0.93 

26 

26.00 

0.00 

16.60 

1.01 

27 

26.00 

0.00 

16.30 

1.04 

28 

26.00 

0.00 

16.50 

1.06 

29 

26.00 

0.00 

16.50 

1.02 

30 

26.00 

0 . 00 

16 . 20 

1.01 

HQ  TAC  requirements  called  for  a  standard  deviation  for 
sorties  of  less  than  1.25  and  a  standard  deviation  for  fully 
mission  capable  aircraft  of  less  than  1.0  (5).  Since 
neither  pilot  run  met  the  requirement,  15  runs  were  made. 
Sample  results  are  shown  in  Table  6  and  Table  7. 


Table  7.  Output  Variances  For  15  Runs  Coronet  Warrior  Data 


SORTIE 


OUTPUT 


DAY 

MEAN 

STD.  DEV. 

MEAN 

STD.  D 

1 

55.00 

0.00 

23.10 

0.13 

2 

55.00 

0.00 

21.70 

0.23 

3 

55.00 

0.00 

21.00 

0.28 

4 

55.00 

0.00 

20.90 

0.23 

5 

55.00 

0.00 

20.50 

0.27 

6 

55.00 

0.00 

20.10 

0.33 

7 

55.00 

0.00 

19 . 60 

0.30 

8 

26.00 

0.00 

19.50 

0.33 

9 

26.00 

0.00 

19.70 

0.34 

10 

26.00 

0.00 

19.90 

0.32 

11 

26.00 

0.00 

19 . 80 

0.32 

12 

26.00 

0.00 

19.80 

0.26 

13 

26.00 

0.00 

19.90 

0.31 

14 

26.00 

0.00 

19.70 

0.33 

15 

26.00 

0.00 

19.50 

0.34 

16 

26.00 

0.00 

19.50 

0.30 

17 

26.00 

0.00 

19.30 

0.32 

18 

26.00 

0.00 

18.90 

0.34 

19 

26.00 

0.00 

18.60 

0.34 

20 

26.00 

0.00 

18.40 

0.34 

21 

26.00 

0.00 

18.40 

0.27 

22 

26.00 

0.00 

18.40 

0.28 

23 

26.00 

0.00 

18 . 20 

0.28 

24 

26.00 

0.00 

18.20 

0.34 

25 

26.00 

0.00 

17.70 

0.34 

26 

26.00 

0.00 

17.40 

0.38 

27 

26.00 

0.00 

17.40 

0.41 

28 

26.00 

0.00 

17.10 

0.40 

29 

26.00 

0.00 

17.00 

0.40 

30 

26.00 

0.00 

16.70 

0.40 

The  15  runs  still  did  not  reduce  the  standard  deviations  to 
the  desired  levels.  In  response  to  this,  a  test  using  50 
runs  was  completed.  Results  are  displayed  in  Tables  8  and 


Table  8.  Output  Variances  For  50  Runs  TAC  Sample  Data 

OUTPUT 

S.QRTIE  EH£ 


DAY 

MEAN 

STD.  DEV. 

MEAN 

STD.  D 

1 

55.00 

0.00 

22.60 

0.08 

2 

55.00 

0.00 

19.90 

0.21 

3 

54.80 

0.13 

17 . 80 

0.29 

4 

53.40 

0.43 

16 . 00 

0.32 

5 

51.10 

0.69 

14.40 

0.29 

6 

48.80 

0.89 

13.40 

0.30 

7 

47.30 

1.01 

12.80 

0.30 

8 

26.00 

0.00 

12.50 

0 . 30 

9 

26.00 

0.00 

13.10 

0.28 

10 

26.00 

0.00 

13.50 

0.31 

11 

26.00 

0.00 

13.50 

0.35 

12 

26.00 

0.00 

13.70 

0.34 

13 

26.00 

0.00 

13.70 

0.33 

14 

26.00 

0.00 

13.40 

0.35 

15 

26.00 

0.02 

13.10 

0.33 

16 

25.90 

0.06 

12.90 

0.32 

17 

25.90 

0.06 

12.80 

0 . 31 

18 

26.00 

0.00 

12.40 

0.31 

19 

26.00 

0.00 

12.00 

0.32 

20 

25.90 

0.12 

11.50 

0.30 

21 

26.00 

0.04 

10.90 

0.30 

22 

26.00 

0.02 

10.40 

0.31 

23 

25.80 

0.09 

10.00 

0.32 

24 

25.30 

0.30 

9.50 

0.34 

25 

24.60 

0.39 

8.90 

0.36 

26 

23.60 

0.60 

8.20 

0.38 

27 

22.90 

0.68 

7.60 

0.37 

28 

22.10 

0.74 

7.20 

0.36 

29 

21.40 

0.75 

7.00 

0.37 

30 

21.30 

0.81 

6.70 

0.36 

Table  9.  Output  Variances  For  50  Runs  Coronet  Warrior  Data 


SORTIE 


OUTPUT 


MEAN 

55.00 

55.00 

55.00 

55.00 

55.00 

55.00 

54.90 

26.00 

26.00 

26.00 

26.00 

26.00 

26.00 

26.00 

26.00 

26.00 

26.00 

26.00 

26.00 

26.00 

26.00 

26.00 

26.00 

26.00 

26.00 

26.00 

26.00 

26.00 

26.00 

26.00 


0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.06 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 


MEAN 

23.10 
21.80 

21.10 
20.60 
20.10 
19.60 
19 . 40 
19.40 
19.60 
19.70 

19.80 

19.70 

19.60 
19.50 

19.40 

19.20 
19.10 

18.80 

18.60 

18.40 

18.30 

18.20 
18.00 

17.90 

17.70 

17.40 

17.30 
17.20 

16.90 

16.70 


0.06 

0.13 

0.14 

0.16 

0.18 

0.21 

0.20 

0.21 

0.19 

0.18 

0.17 

0.15 

0.17 

0.18 

0.19 

0.19 

0.20 

0.20 

0.22 

0.23 

0.22 

0.22 

0.38 

0.23 

0.21 

0.21 

0.20 

0.21 

0.23 

0.25 


Plots  of  each  run  by  day  versus  the  number  of  sorties  and 
versus  the  number  of  FMC  aircraft  are  shown  in  Appendix  F. 
These  plots  should  give  some  idea  of  the  variability  of  the 
research  model  for  the  50  runs.  These  runs  met  the  TAC 
variance  requirements. 


Using  the  data  collected  from  the  50  runs,  a  comparison 
between  the  Dyna-METRIC  model  and  the  research  model  was 
performed.  This  -/as  done  by  calculating  the  differences 
between  output  means  day  by  day.  These  60  differences  were 
then  averaged  and  a  standard  deviation  calculated.  Based  on 
the  Central  Limit  Theorem  and  the  large  sample  size 
(38:279-280),  a  hypothesis  test  using  the  normal 
approximation  was  used  (38:388-392).  The  following  gives 
the  test  and  test  results.  The  Alpha  level  in  both  tests 
was  equal  to  0.05.  The  first  test  was  from  the  TAC  sample 
data.  The  second  was  from  the  Coronet  Warrior  data. 

TEST  1:  Ho:  Dyna-METRIC  model  output  -  Research  model 
output  =  0. 

Ha:  Difference  does  not  equal  zero. 

Test  statistic: 

Z  =  SD-HD/S 

Z  =  1.540  -  0/  1.827  =  0.8429 

Rejection  Region: 

|Z|  >  Z(<*/2) 

I  Z |  >  1.96 

where 

SD  =  sample  difference  in  model  outputs 
HD  =  null  hypothesis  difference  in  output  means 
S  =  sample  standard  deviation 
These  values  were  calculated  using  a  fortran  program  and  a 
SAS  program  given  in  Appendix  G.  The  Z  value  was  not  in  the 


rejection  region  and  therefore,  no  significant  difference 
exists  between  the  research  model  output  and  the  Dyna-METRIC 
model  output. 

TEST  2:  Ho:  Dyna-METRIC  model  output  -  Research  model 
output  «  0 . 

Ha:  Difference  does  not  equal  zero. 

Test  statistics: 

Z  *  SD  -  HD/  S 

Z  -  0.0285  -  0  /  0.440  -  0.0648 
Rejection  Region: 

I Z |  >  Z<  /2 ) 

IZI  >  1.96 

where 

SD  *  sample  difference  in  model  outputs 
HD  *  null  hypothesis  difference  in  output  means 
S  *  sample  standard  deviation 
These  values  were  calculated  using  a  Fortran  program  and  a 
SAS  program  given  in  Appendix  G.  The  Z  value  was  not  in  the 
rejection  region  and  therefore,  no  significant  difference 
exists  between  the  research  model  output  and  the  Dyna-METRIC 
model  output. 

The  following  two  figures  show  the  output  differences 
between  the  research  model  and  the  Dyna-METRIC  model  for 
each  output  by  deployment  day.  Figure  5  shows  the 
differences  in  the  number  of  sorties  by  day  between  the 
Dyna-METRIC  model  and  the  research  model.  The  Ts  are  the 


differences  betweeen  the  models  for  the  TAC  sample  data  and 
the  Cs  are  the  differences  between  the  models  for  the 
Coronet  Warrior  data.  Figure  6  shows  the  differences  in  the 
number  of  fully  miss  ion-capable  aircraft  by  day  between  the 
Dyna-METRIC  model  and  the  research  model.  Again,  the  Ts 
represent  the  TAC  sample  data  and  the  Cs  represent  the 
Coronet  Warrior  data.  The  actual  calculated  differences  are 
given  in  Appendix  G.  The  daily  output  data  for  the 
Dyna-METRIC  model  and  the  research  model  and  plots  of  the 
appropriate  calculated  daily  averages  versus  sorties  and 
versus  FMC  aircraft  for  the  research  model  are  also  given  in 
Appendix  G. 


The  results  in  Chapter  Four  present  a  clear  picture  of 
the  research  performed  in  this  thesis  effort.  Chapter  Five 
will  draw  some  conclusions  from  the  results  and  recommend 
future  areas  for  research. 
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This  chapter  draws  several  conclusions  based  on  the 


results  given  in  Chapter  Four  and  then  presents  some 
recommendations  for  future  research. 


Conclusions 

First,  in  selecting  SLAM  II  PC  as  the  programming 
language,  HQ  TAC  considered  price,  portability,  widespread 
acceptance  of  the  language,  and  knowledge  by  the  author  as 
primary  reasons  for  using  SLAM  II  PC.  They  also  liked 
SLAM's  optional  graphics  edit  capability  and  the  optional 
graphics  simulation  display.  There  are  some  short-comings. 
First,  simulation  on  the  PC  is  slow.  Fifty  runs  takes 
almost  an  hour,  averaging  about  a  minute  a  run.  Also, 
compiling  and  executing  the  PC  version  and  then  using  the 
output  is  more  difficult  than  with  the  mainframe  version. 

The  results  from  the  repair  time  distribution  tests  are 
inconclusive.  Either  distribution  seems  to  fit  the  data  in 
most  cases.  To  make  a  distinction  more  repair  time  data 
should  be  collected. 

The  research  model  emulates  Dyna-METRIC  fairly  well. 

The  P-values  for  the  two  hypothesis  tests  are  small. 

Looking  at  Figures  5  and  6  in  Chapter  4,  one  thing  should  be 


noted.  The  only  significant  differences  in  results  can  be 
seen  between  day  5  and  day  7  and  after  day  22  in  the  TAC 
sample  data.  The  research  model  predicts  higher  results 
than  Dyna-METRIC.  This  is  encouraging  since  Dyna-METRIC 
output  tends  to  be  pessimistic  in  the  later  stages  of  the 
model  run.  This  is  because  Dyna-METRIC  bases  failures  on 
required  sorties  rather  than  actual  sorties  flown,  thus  more 
aircraft  break  and  fewer  sorties  are  flown  than  would  be 
expected.  Also,  note  that  this  dramatic  decrease  in 
performance  was  not  evident  in  the  Coronet  Warrior  exercise 
(7).  A  larger  variance  in  the  TAC  sample  results  can  also 
be  attributed  to  the  larger  number  of  LRUs  aggregated  in  the 
research  model.  Additional  plots  of  the  output  data  are 
available  in  Appendix  G. 

In  addition  to  providing  emulation  capability  on  the 
PC,  this  model  provides  TAC  with  the  capability  to  constrain 
maintenance  personnel  and  equipment.  It  also  gives  the  user 
the  ability  to  break  out  maintenance  times  by  individual 
tasks  and  provides  enhanced  scheduling  capabilities.  With 
the  addition  of  SLAM  upgrades,  graphics  modification  and 


graphics  display  capabilities  will  be  possible.  The  model 
does  have  some  limitations.  These  limitations  include 
limiting  the  number  of  LRUs  and  SRUs  modeled  and  limiting 


the  number  of  failures  per  sortie  to  two  (see  Appendix  C). 

In  conclusion  the  completed  research  model  provides  HQ 
TAC  with  an  analytical  tool  not  available  before  on  the  PC. 


It  also  provides  maintenance  constraints  and  scheduling 
flexibility  that  didn't  exist  in  previous  models.  In 
addition,  its  initial  emulation  and  favorable  comparison 
with  Dyna-METRIC  provides  easier  acceptance  of  the  model  by 
TAC  users  . 


Recommendations 


There  exist  several  areas  of  research  which  can  grow 
from  this  basic  work.  First,  more  data  can  be  collected  and 
a  study  done  on  repair  time  distributions.  Research  should 
not  only  study  the  actual  distribution  of  the  repair  times 
but  the  impact  or  significance  of  using  one  distribution 
versus  another  on  the  results  of  this  model.  Another  area 
which  could  Improve  the  results  of  this  model  is  research 
into  implementing  variance  reduction  techniques  in  the 
model.  This  work  could  reduce  the  number  of  runs  to  achieve 
a  specified  accuracy.  Another  area  of  research  is  enhancing 
the  processing  of  the  model  input  and  output.  It  could 
include  direct  user  input  into  the  model  and  customized 
report  builders.  The  largest  area  for  potential  work  is  in 
sensitivity  analysis  using  the  enhanced  capabilities  of  this 
model.  The  future  researcher  could  implement,  test,  and 
draw  conclusions  on  the  impact  of  various  maintenance  and 
scheduling  constraints  on  TAC  fully  mission-capable  status 
and  sortie  generation  capability.  Sensitivity  analysis  on 
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these  results  could  have  a  significant  effect  on  WRSK 
sparing  levels,  maintenance  manning  levels,  and  types  and 
quantities  of  other  equipment  deployed  with  a  unit. 


FTWARE  BRIEF  OPERATING  OTHER  OTHER  MODELINO  APPROXIMATE 

NAME  DESCRIPTION  COMPUTERS  SYSTEM  SOFTWARE  RAM  HARDWARE  CAPABILITIES  PRICE 


FIOVN 


XX(8)**TN0W-AT (  1 )  ,  Y -  AT(7) 


o  o  o  o 


FIRST  TWO  LINES  SET  FILE  SPACE  RESTRICTIONS 
AND  NO.  OF  RUNS 

GEN, TLEWI S , THESIS ,7/21/8 7,  50, ,N, ,N,N, 72; 

LIM, 10, 10, 500 ; 

NETWORK ; 

RESOUR CE/LRU1 (  0  ) ,  4 , 3 ; 

RESOURCE/LRU2 ( 0 ) , 4 , 3 ; 

RESOURCE/LRU3 ( 0 ) , 4 , 3 ;  LRU  SPARES  AVAILABLE 

RESOURCE/LRU4 ( 0 ) , 4 , 3 ; 

RESOURCE/LRU 5 ( 0 ) , 4 , 3 ; 

RESOURCE/LRU6 ( 0 ) , 4 , 3 ; 

RESOURCE/LRU7 (  0  ) ,  4 , 3 ; 

RESOURCE/LRU8 ( 0 ) , 4 , 3 ;  LRU  SPARES  AVAILABLE 

RESOUR CE/LRU9 ( 0 ) , 4 , 3 ; 

RESOURCE/LRU10 ( 0 ) , 4 , 3 ; 

RESOUR CE/LRU11 ( 0 ) , 4 , 3 ; 

RESOURCE/LRU12 ( 0 ) , 4 , 3 ; 

RESOURCE/LRU13 ( 0 ) , 4 , 3 ;  LRU  SPARES  AVAILABLE 
RESOURCE/LRU1 4 (  0  ) ,  4 , 3  ; 

RESOURCE/LRU1 5 ( 0 ) , 4 , 3 ; 

RESOURCE/LRU16 { 0 ) , 4 , 3 ; 

RESOUR CE/LRU1 7 ( 0 ) , 4, 3; 

RESOURCE/LRU18 (0),4,3;  LRU  SPARES  AVAILABLE 
RESOURCE/LRU19 ( 0 ) , 4, 3; 

RESOURCE/LRU20 ( 0 ) , 4 , 3 ; 

RESOURCE/LRU2 1 ( 0 ) , 4, 3; 

RESOURCE/LRU22 ( 0 ) , 4 , 3 ; 

RESOUR CE/LRU23 ( 0 ) , 4 , 3 ;  LRU  SPARES  AVAILABLE 
RESOURCE/LRU2 4 ( 0 ) , 4 , 3 ; 

RESOURCE/LRU2 5 ( 0 ) ,  4 , 3 ; 

RESOURCE/LRU26 ( 0 ) ,  4 , 3 ; 

RESOURCE/LRU27 ( 0 )  ,  4 , 3;  LRU  SPARES  AVAILABLE 
RESOURCE/LRU2 8  (  0 ) ,  4 ,  3 ; 

RESOURCE/LRU29 ( 0 ) ,  4 , 3; 

RESOURCE/LRU3 0 (  0  ) ,  4 , 3 ; 

RESOURCE/LRU31 ( 0 )  ,  4 , 3; 

RESOURCE/LRU 3 2 ( 0 ) , 4 , 3 ;  LRU  SPARES  AVAILABLE 
RESOURCE/LRU3  3 ( 0 ) ,  4 , 3  ; 

RESOURCE/LRU3  4 { 0 ) ,  4 ,  3  ; 

RESOURCE/LRU 3 5 ( 0 )  ,  4 , 3 ; 

RESOURCE/LRU36 { 0 ) ,  4 ,  3 ; 

RESOURCE/LRU37 ( 0 ) , 4 , 3;  LRU  SPARES  AVAILABLE 
RESOURCE/LRU 3 8 ( 0 ) , 4 , 3 ; 

RESOURCE/LRU 3 9 (  0  ) ,  4, 3; 

RESOURCE/LRU40  (  0 )  ,  4,3; 


2/; 


HHuS^i^uS^^vf^Ss^ufl^filwSei^pSSi^aT^ssESSMEMT 

AMD  SORTIE  GENERATI  «U>  AIR  FORCE  INST  OE  TECH 
WRIGHT-PATTERSON  AF6  OH  SCHOOL  OF  ENGI  T  P  LEWIS 
UNCLASSIFIED  DEC  87  AF I T/G0R/ENS/87D-9  F/G  15/5  NL 


onooo  ooooooo  o  ooo  o  on  o  ooooo 


EQUIPMENT/MAI NTENCE  MEN  AVAILABLE 


C 


RESOUR CE/EQ( 25), 6, 5, 2; 

GATE, DAY, ,1; 

GATE, FIX,, 7; 

SCHEDULING  MODULE 

GETS  DAILY  SCHEDULE 

CREATE  24  0  * 

COUNTS* THE  DAY  AND  THE  HOUR 

ASS, XX ( 52 ) =XX( 51)*24,XX(51) =XX ( 51 ) +1; 

EVENT, 2;  GETS  DAILY  SCHEDULE 

COUNTS  THE  NUMBER  OF  FMC  AIRCRAFT  AT  THE  BEGINNING  OF 
DAY 

ASS, XX ( 6)s0,XX(2)s0,XX(5) =NNQ( 1 ) +NNQ( 7 ) ; 

OPEN, FIX; 

ACT, 0.005; 

CLOSE, FIX;  CONTROLS  THE  LAUNCH  OF 

OPEN , DAY ;  AI RCR AFT 

ACT, 23. 99; 

GOON; 

CLOSE, DAY; 

COLLECTS  DAILY  OUTPUT  STATISTICS 
EVENT, 6; 

COLCT, XX (6), SORTIES  FLOWN; 

TERM; 

AIRCRAFT  MODULE 

CREATE ,  0 , 0 ,  ,  2 4  ,*  CREATES  AIRCRAFT 
COUNTS  FMC  A/C  AND  MARKS  THE  TAIL  NO. 

ASS, XX ( 1 ) =XX( 1 ) +1,XX( 5 ) =XX ( 54 ) , ATRIB ( 5 ) =XX ( 1 ) ; 

EVENT, 4;  ASSEMBLES  AIRCRAFT 
ASS, XX ( 56 ) =TNOW-XX ( 52 ) +XX ( 4 ) , 1; 

IS  THERE  ENOUGH  TIME  TO  FLY  ANOTHER  SORTIE  ? 

IF  NO,  GO  TO  THE  END  OF  THE  DAY 

IF  YES,  HAVE  ALL  THE  REQUIRED  SORTIES  BEEN  FLOWN  ? 

IF  YES,  GO  TO  THE  END  OF  THE  DAY 
IF  NO,  FLY  A  SORTIE 

ACT, , XX(56) .GT. 23.98, EOD; 

ACT, , XX ( 6 ) . LT. XX( 61 ) , SORT; 

ACT; 

END  OF  THE  DAY 
CLOSE  HANGAR 
WAIT  FOR  NEXT  DAY 
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uuouoo  u  oooo  oouuu  ooooo  uuouo 


EOD  CLOSE, DAY; 

ACT, , ,BDAY; 

FLY  A  SORTIE 

IF  A/C  HAS  FLOWN  THE  MAXIMUM  SORTIE  GENERATION  RATE 
SEND  IT  TO  THE  HANGAR 

SORT  GOON,l; 

ACT, , ATRIB( 7 ) .GE.3,E0; 

ACT; 

COUNTS  SORTIES 

SOR1  ASS,  ATRIB(  7  )  =»ATRIB  ( 7  )  +1, XX(  6  )  =XX(  6 )  +1; 

ACT/1, XX ( 4);  FLYS  SORTIE 

CALCULATES  THE  NUMBER  OF  LRU  FAILURES  AND  THE  AIRCRAFT 
REPAIR  TIME 

ASSIGN, ATRIB( 6 ) =XX ( 7 ) *XX ( 4 ) ; 

ASSIGN, XX( 59 ) *1 . 1142923*24/XX ( 66 ) ; 

GOON,l; 

CHECKS  TO  SEE  IF  THE  AIRCRAFT  IS  BROKEN 
IF  YES,  GO  TO  THE  REPAIR  MODULE 
IF  NO,  RETURN  TO  THE  FLT.  LINE 

ACT, , ATRIB( 6 ) . GT . 1 . 0, BRK; 

ACT, , ATRI B ( 6 ) , BRK ; 

ACT, ,,BDAY; 

EO  GOON,l; 

ACT, , ATRIB( 7 ) .GT. 3, FIX; 

ACT,, 0.5, FIX; 

ACT, , , SOR1; 

HAVE  ALL  THE  REQUIRED  SORTIES  BEEN  FLOWN? 

IF  YES,  GO  TO  HANGAR 

IF  NO,  TRY  TO  FLY  ANOTHER  SORTIE 

BDAY  AWAIT (1), DAY; 

ASS, XX( 8 ) *TNOW-XX( 52 ) , 1; 

ACT, ,XX( 8 ) .LT.XX ( 4 ) , RES; 

ACT, , , BEG; 

RES  ASS, ATRIB( 7 ) =0; 

ACT,,, BEG; 

REPAIR  MODULE 

COLLECTS  TIME  BETWEEN  FAILURE 

BRK  COLCT, BETW, TIME  BTW  FAIL; 

ASSIGN, ATRIB(l)=TNOW;  MARKS  TIME  OF  FAILURE 
STB1  AWAIT( 2 ) , EQ/1;  WAITS  FOR  REPAIR  MAN/EQUIPMENT 


non  _  _  ooonooo  ooooooooo  non  ooo 


STB  ASSIGN, XX (60) «XX( 66 )/XX ( 7 ) , 1; 

CHOOSES  BROKEN  PART 
EVENT, 1,1; 

ACT, , ATRIB ( 8 ) . EQ . 0, FIX1; 

ACT/ 2 , XX ( 9 ) ;  REMOVES  PART 

CAN  WE  CANNIBALLIZE  ? 

GOON,l; 

ACT , , XX ( 5  3 ) . EQ . 1 , CANN ; 

ACT, ,XX( 53 ) .EQ. 0; 

FREE,EQ/1; 

ACT, ,,NCAN; 

IF  CANNIBALIZATION  IS  ALLOWED 
DETERMINE  IF  LRU  IS  AVAILABLE? 

IF  YES,  GET  LRU 

IF  NO,  MAKE  A/C  LRUS  AVAILABLE  TO  OTHER  A/C,  WAIT  FOR 
THE  BROKEN  LRU  AND  RELEASE  MAINTENENCE  MAN/EQUIPMENT 

SEND  LRU  TO  REPAIR 

CANN  EVENT, 3, 2; 

ACT, , , ILVL; 

ACT, , ATRIB ( 3 ) . EQ . 0 , FRE; 

ACT; 

IF  CANNIBALIZATION  IS  NOT  ALLOWED 
DETERMINE  IF  LRU  IS  AVAILABLE? 

IF  YES,  GET  LRU 

IF  NO,  WAIT  FOR  LRU  AND  RELEASE  MAINTENENCE 
MAN/EQUIPMENT 

NCAN  AWAIT ( 4 ) , ALLOC ( 2 ) , 1 ; 

ACT,, XX (53) .EQ.1,REPR; 

ACT, ,XX(53) . EQ . 0 ; 

AWAI T ( 6 ) , EQ/ 1 ; 

ACT, , , REPR; 

FRE  FREE,EQ/1;  FREE  MAINTENANCE  MAN/EQUIPMENT 
AWAIT ( 3 ) , ALLOC ( 1) ;  WAIT  FOR  LRU 

AWAIT( 5 ) , EQ/1;  WAIT  FOR  MAINTENANCE  MAN/EQUIPMENT 


REPR  GOON; 

ACT/ 3 , XX ( 9 ) ;  REPLACE  LRU 

COLLECTS  REPAIR  TIME 
GO  COLCT, INT( 1) , REPAIR  TIME; 


ooo  ooo  non  o  ooo  ooo  ooo  no 


FREES  MAINTENANCE  RESOURCES 
FREE,EQ/1,1; 

ACT, , ATRIB(l) . EQ . TNOW, BDAY ; 

ACT; 

RETURN  TO  FLIGHT  LINE 

ASS,XX(8)*TN0W-ATRIB(1),1; 

ACT, ,XX(8) .LT. 24, BDAY; 

ACT; 

ASS, ATRIB( 7 ) =0; 

ACT, , , BDAY; 

FIX  AWAIT ( 7 ) ,FIX; 

ACT,,, BDAY; 

A/C  REPAIR  CYCLE 

FI XI  GOON,l; 

REPAIR  TIME 

ACT,EXPON(XX( 59 ) , 2 ) , XX ( 58 ) , TO; 

ACT; 

FREE  MAINTENANCE  RESOURCES 
TO  FREB,EQ/1; 

RETURN  TO  FLIGHT  LINE 

GOON,l; 

ACT,, ATRIB( 1 ) .EQ.TNOW, BDAY; 

ACT; 

ASS, XX ( 8 ) -TNOW-ATRIB ( 1 ) , 1; 

ACT,,XX(8) .LT. 24, BDAY; 

ACT; 

ASS, ATRIB( 7 ) *0; 

ACT,,, BDAY; 

LRU  REPAIR 

ILVL  GOON; 

ACT , , , EVE ; 

ACT, , ATRIB( 9 ) .GT.O; 

ASS,  ATR I B (  2  )  =  ATR I B  (  9  ) ; 

CHOOSE  BROKEN  SRUS  AND  NRTS  RATES 

EVE  EVENT, 5; 

GOON,l; 

ACT, ,XX( 57 ) , TER; 

ACT/4, EXPON(ATRIB (10 ),2);  REPAIR  LRU 
GOON,l; 
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ACT, , ATRIB ( 9 ) . EQ . 0,FR; 

ACT; 

DECIDES  IF  SRU  IS  AVAILABLE? 

IF  YES,  RETURNS  LRU  TO  SUPPLY 
IF  NOT,  THEN  CANNIBALIZES  SRUS,  IF  POSSIBLE 

EVENT, 7,1; 

ACT, , ATRIB ( 3 ) . EQ . 1 , FR ; 

ACT; 

QUE ( 8 ) ; 

FR  FREE, ATRIB( 2 )/l;  FREE  LRU 

TER  TERM; 

END; 

INIT, 0. , 720, N;  RUNS  MODEL  FOR  30  DAYS  (720  HRS.) 
SIM; 

FIN; 
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CHOOSES  BROKEN  LRUS 


F  C  D  e 
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6 


94 


F  E 


SETS  FLIGHT  SCHEDULE 
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CHECKS  TO  SEE  IF  LRU  IS  AVAILABLE 


BUILDS  AIRCRAFT 


OUTPUT  STATISTICS 


XX(5)=(XX(5)  +  NNQ(  1  )  +  NNQ(7))/2 
MDAY-XX<51) 

FMC(  MDAY) -FMC(  MDAY) +XX(  6) 
MS0R<  MDAY)  -MSOR(  MDAY) +XX(  6) 


PRINT,* 

RUN,XX<51),XX(6),XX(5) 


CHOOSES  BROKEN  SRU 


ALLOCATES  SRUS 


NLRU-AT<2) 

N»$RULOC(NLRU)+TLRU(NLRU)- 1 
L-SRULOC(NLRU) 
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ALLOCATES  LRUS (CANNS) 


’YTri/TrL 
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ALLOCATES  LRUS  (NO  CANN) 


onoo  o  o  o 


SLAM  FORTRAN  BVEttT  CODE 


I NCLUDE : ' PRCTL . FOR 1 
PROGRAM  MAIN 
DIMENSION  NSET( 10000) 

COMMON / S COM1/ ATR I B ( 100 ) , DD ( 100 ) , DDL ( 100 ) , DTNOW, I I , MFA, MSTOP, 
NCLNR 

1 , NCRDR , NPRNT , NNRUN ,NNSET, NTAPE ,38(100), S SL ( 1 0  0  )  , TNEXT , TNOW, 
XX(100) 

COMMON  QSET( 10000) 

EQUIVALENCE (NSET(1),QSET(1) ) 

NNSET=10000 
NCRDR =5 
NPRNT® 6 
NTAPE =7 
CALL  SLAM 
END 


SUBROUTINE  EVENT ( I ) 

COMMON/SCOMl/ATRI B ( 100 ) , DD ( 100 ) , DDL ( 100 ) , DTNOW, I I , MFA, MSTOP, 
NCLNR 

1, NCRDR, NPRNT, NNRUN, NNSET, NTAPE, SS(100), SSL(100) , TNEXT, TNOW, 
XX(100) 

COMMON/MI NE/REP AI RT ( 4  0 ) , NRTS (40), QP A (40), RUN , STK ( 30 ) , SQP A ( 3  0 
) 

1 , TLRU ( 40 ) , SRULOC( 40 ) , SRUDM( 30 ) ,MSOR ( 30 ) ,FMC( 30 ) 

GO  TO  (1,2, 3, 4, 5, 6, 7)  I 

CHOOSES  BROKEN  LRU 

1  ATR I B ( 8 ) ® 1 

ATRIB ( 9 ) =0 
ATRIB( 2 )  =0 
ATRIB( 10 ) =0 

USES  RANDOM  DRAWS  TO  CHOOSE  BROKEN  LRUS 
AND  THE  NUMBER  OF  DEMANDS 

IF  (ATRIB(6) .LT.l)  GO  TO  17 
ATRIB ( 6 ) ®ATRIB ( 6 ) -1 
DRAW=UNFRM ( 0 . 0 , 1 . 0 , 3 ) 

IF  ( DRAW. LT . ATRIB ( 6 ) )  THEN 
ATR I B ( 8 ) s  2 
END  IF 

17  DRAW=UNFRM ( 0 . 0 , 1 . 0 , 4  ) 

IF  ( DRAW . LT . XX ( 6 0 ) )  THEN 
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IF  ( ATRI B ( 8 ) . EQ . 1 . 0 )  THEN 
ATRIB( 8 ) =0 
GO  TO  21 
END  IF 

GETS  THE  REPAIR  TIME 

ATRI B( 10 ) =EXPON ( XX ( 59 )  ,  5 ) 

ATRIB( 8 ) =ATRIB ( 8 ) -1 
GO  TO  17 
END  IF 

15  DRAW*UNFRM(0.0,1.0,5) 

J=INT( 10+XX( 55 ) ) 

DO  10  1*11, J 

IF  (XX( I ) . GE.DRAW)  GO  TO  20 
10  CONTINUE 

20  IF  ( ATRI B ( 2 ) . EQ . 0 . 0 )  THEN 

MARKS  THE  BROKEN  LRUS 

ATRIB( 2) *1-10 
ELSE 

ATRIB(9)*I-10 
END  IF 

DECIDES  WHERE  THE  REPAIR  IS  TO  TAKE  PLACE 

IF  ( ATRI B ( 8 ) . GT . 1 . 0 )  THEN 
ATRIB(8)*1 

DRAW*UNFRM( 0 . 0, 1 . 0, 4 ) 

IF  ( DRAW . LT . XX ( 6 0 ) )  GO  TO  21 
GO  TO  15 
END  IF 

IF  (ATRIB(9) . EQ.ATRIB(2) )  THEN 
LRU*INT(ATRIB(2) ) 

IF  (QPA(LRU) .GT.l)  GO  TO  21 
GO  TO  15 
END  IF 

21  RETURN 


FLIGHT  SCHEDULE 

2  IF ( XX( 51 ) . GE . 8 )  GO  TO  22 

XX(3)-2.3  FIRST  7  DAYS 

XX<4)*1.8 

GO  TO  24 

22  XX ( 3 ) *1 . 1  DAY  8  TO  DAY  30 

XX(4)«1.8 

GETS  DAILY  SORTIE  REQUIREMENT 


onno  ooo  oooo  ooo  ooo 


24  XX ( 61 ) *XX( 54 ) *XX ( 3 ) 

ROUND=XX( 61 ) -INT(XX( 61 ) ) 

IP  (ROUND.LT. 0.5)  XX ( 61 ) =INT( XX ( 61 ) ) 
RETURN 


ARE  THE  BROKEN  LRUS  AVAILABLE? 


3  ATRIB( 3 ) =0 

LRU1=INT( ATRIB ( 2 ) ) 

LRU2=INT( ATRIB(9 ) ) 

IF  (LRU1.EQ.LRU2)  THEN 
IF  (NNRSC(LRUl) . GT.l)  GO  TO  30 
GO  TO  35 
END  IF 

IF  YES,  GET  LRUS 

IF  (NNRSC(LRUl) .GT.O)  THEN 
IF  (LRU2.LE.0)  GO  TO  30 
IF  (NNRSC(LRU2) .GT.O)  GO  TO  30 
END  IF 

35  J=INT(XX( 55) ) 

IF  THE  BROKEN  LRUS  ARE  NOT  AVAILABLE,  MAKE  THE  A/C 
LRUS  AVAILABLE  TO  OTHER  AIRCRAFT 

DO  25  1*1, J 
LRUQPA*INT(QPA( I ) ) 

IF  ( I .EQ. ATRIB ( 2 ) )  LRUQPA=LRUQPA-1 
IF  ( I .EQ. ATRIB (9 ) )  LRUQP A=LRUQP A- 1 
CALL  FREE (I, LRUQP A) 

25  CONTINUE 
RETURN 

30  ATR I B ( 3 ) = 1 

RETURN 

ASSEMBLES  AIRCRAFT  AT  BEGINNING  OF  MODEL 


4  J=INT(XX( 55 ) ) 

DO  40  1*1, J 
LRUQPA=INT ( QPA( I ) ) 
CALL  SEIZE ( I, LRUQP A) 
40  CONTINUE 
RETURN 


DECIDES  IF  THERE  IS  A  BROKEN  SRU  ? 
IF  YES,  IT  CHOOSES  ONE 
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5  I=INT(ATRIB(2) ) 

IF  (TLRU(I) .LE.O)  GO  TO  53 

DRAW>UNFRM ( 0 . 0 , 1 . 0 , 6  ) 

N3INT( SRULOC ( I ) ) 

L=INT( SRULOC ( I ) +TLRU ( I ) -1 ) 

DO  52  M*N,L 

I F ( SRUDM ( M ) . GE . DRAW )  THEN 
ATRIB(9)=M 
GO  TO  55 
END  IF 

52  CONTINUE 

53  ATRIB(9)=0 

GETS  NRTS  RATE  AND  REPAIR  TIME 

55  XX(  57 )  =*NRTS  ( I ) 

ATRIB(10 ) =REPAIRT( I ) 

RETURN 


CALCULATES  OUTPUT  STATISTICS 

6  XX ( 5 ) = ( XX ( 5 ) +NNQ ( 1 ) +NNQ ( 7 ) ) / 2 

MDAY=INT( XX( 51 ) ) 

FMC ( MDAY ) =FMC ( MDAY ) +XX ( 5 ) 

MSOR ( MDAY ) =MSOR ( MDAY ) +XX ( 6 ) 
PRINT*, RUN, XX ( 51 ) ,  XX ( 6 ) ,XX ( 5 } 
RETURN 


IS  THE  BROKEN  SRU  AVAILABLE  ? 

IF  YES,  FIX  LRU 

IF  NO,  CANNIBALIZE  THE  LRU,  IF  POSSIBLE 

7  ATRIB ( 3 ) *0 

SRU*INT( ATRIB( 9 ) ) 

I F ( STK ( SRU ) . GT . 0 )  THEN 

ATRIB ( 3 ) *1 

STK ( SRU) =STK ( SRU) -1 

GO  TO  75 

END  IF 

NLRU=INT(ATRIB(2) ) 

N* I NT ( SRULOC ( NLRU ) +TLRU ( NLRU ) - 1 ) 

L=INT ( SRULOC ( NLRU) ) 

DO  72  I=L,N 
SRUQPA*INT ( SQPA( I ) ) 

IF ( ATRIB ( 9 ) . EQ . I )  SRUQPA=SRUQPA-1 
STK ( I ) *STK ( I ) +SRUQPA 
72  CONTINUE 
75  RETURN 
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END 


SUBROUTINE  INTLC 

C0MM0N/SC0M1/ATRIB ( 100 ) ,DD(100) , DDL ( 100 ) , DTNOW, I I , MFA, MSTOP, 
NCLNR 

1 , NCR DR , NPRNT , NNRUN , NNSET, NTAPE ,SS(100),SSL(100), TNEXT , TNOW, 
XX (100) 

COMMON/MI NE/REP AI RT(40),NRTS(40),QPA(40), RU# , STK ( 3  0 ) , SQP A ( 3  0 
) 

1,TLRU( 40 ) , SRULOC{ 40 ) , SRUDM( 30 ) 

OPEN ( UNIT* 7, FILE® ' R2THES I S . I NP ' , STATUS  = ' OLD ' ) 

OPEN (UNIT=8,FILE=' SRU. INP', STATUS*' OLD' ) 


READS  IN  INITIAL  VALUES  AND  FAILURE  RATES 

RUN*RUN+1 
ISRU*0 
AM*0 

XX ( 58  ;*0.0125 
XX(66)*0. 32957 
READ (  7  ,  * )  AC 
XX( 54 ) *AC 
READ ( 7  ,  * )  BR 
XX( 7) *BR 
READ (  7  ,  *  )  CANN 
XX ( 53 ) =CANN 
READ (7,*)  LRU 
XX ( 55 ) =LRU 
DO  10  1*1, LRU 

READS  IN  LRU  PART  NO.,  DEMAND  RATE,  QPA,  NO.  OF  LRUS 
IN  STOCK,  NO.  OF  SRUS  IN  LRU,  NRTS  RATE,  REPAIR  CYCLE 
TIME 

READ ( 7 , * )  NUM, FR , QP AS , LRUAV, SRUAV, RTS , REP 

TLRU ( I ) *SRUAV 

IF ( SRUAV. EQ.0)  GO  TO  5 

ISRU1*ISRU+1 

ISRU*INT( ISRU+SRUAV) 

SRULOC(I )*ISRU1 
TOTAL *0 

READS  IN  SRU  DATA 

SRU  NO.,  DEMAND  RATE,  QPA,  NO.  OF  SRUS  IN  STOCK 

DO  2  J  =  I SRUl , I SRU 

READ ( 8 , * ) NU, DM, QPSRU, SRUSTK 

SQPA( J)=QPSRU 


A/C  BREAK  \ 

A/C  DEMANDS/FLYING  HOUR 
NO.  OF  A/C 

TOTAL  DEMANDS/FLYING  HOUR 
IS  CANNIBALIZATION  POSSIBLE  ? 
NO.  OF  LRUS 
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STK ( J ) “SRUSTK 
TOTAL* TOTAL + DM 
SRUDM ( J ) -TOTAL/FR 
2  CONTINUE 
C 

C  BUILDS  THE  CUMULATIVE  FAILURE  DISTRIBUTIONS 
C 

5  NRTS ( I ) *RTS 

REPAIRT( I ) *REP*24 
QPA( I ) =QPAS 

LAV*INT(LRUAV+(XX( 54 ) *QPA( I ) ) ) 

L*I +10 

XX(L)*AM+FR 

AM=XX(L) 

CALL  ALTER ( I , LAV ) 

10  CONTINUE 

DO  20  1*1/ LRU 
L*I+10 

M*10+INT(LRU) 

XX ( L ) *XX ( L ) /XX ( M ) 

20  CONTINUE 
CLOSE ( 7 ) 

CLOSE (8 ) 

RETURN 

END 

SUBROUTINE  OTPUT 

COMMON/ SCOM1/ATR IB ( 100), DD (100), DDL ( 100 ) , DTNOW, I I , MFA, MSTOP , 
NCLNR 

1 , NCRDR , NPRNT , NNRUN , NNSET , NTAPE ,SS(100),SSL(100), TNEXT , TNOW, 
XX(100) 

COMMON/MI NE/REPAI RT ( 4  0 ) , NRTS (40),QPA(40), RUN , STK (30), SQP A ( 3  0 

) 

1,TLRU( 40 ) ,SRULOC( 40 ) , SRUDM ( 30 ) ,MSOR( 30 ) ,FMC( 30 ) 

OPEN ( UNIT=7, FILE* ' S AS . DAT ' , STATUS* ' NEW ) 


:  WRITES  OUTPUT  STATISTICS 

% 

# 

DO  10  1*1,30 
AVGFMC=FMC ( I ) /RUN 
AVGSOR-MSOR ( I ) /RUN 
IF  (RUN.LT.50)  GO  TO  20 
WRITE ( 7, * ) I , AVGFMC, AVGSOR 
10  CONTINUE 

CLOSE ( 7 ) 

20  RETURN 
END 

SUBROUTINE  ALLOC ( I , I FLAG) 


W  ■  w  *  r\*  ri 


ooooooo  ooooooo 


COMMON/ SCOMl/ATR IB ( 100 ) ,00(100 ) , DDL ( 100 ) , DTNOW, I I , MFA, MSTOP 
NCLNR 

1 , NCRDR , NPRNT , NNRUN , NNSET, NTAPE ,SS(100),SSL(100), TNEXT ,  TNOW 
XX(IOO) 

COMMON/MI NE/REP AI RT ( 4  0 ) , NRTS ( 4  0 ) , QP A ( 4  0 ) 

I FLAG3 0 
GO  TO  (1,2)  I 

CANNIBALIZATION  ALLOWED 

ARE  LRUS  AVAILABLE? 

IF  YES,  GETS  LRU 
IF  NO,  USES  FOR  CANNIBALIZATION 

1  J-INT(XX( 55 ) ) 

DO  10  1*1, J 

IF  (NNRSC(I) .LT.QPA(I))  GO  TO  30 
10  CONTINUE 

DO  20  I»1,J 
LRUQPA-INT(QPA( I ) ) 

CALL  SEI ZE ( I , LRUQPA) 

20  CONTINUE 
IFLAG— 1 
30  RETURN 


CANNIBALIZATION  NOT  ALLOWED 

ARE  LRUS  AVAILABLE? 

IF  YES,  GETS  LRU 
IF  NO,  WAITS  FOR  PARTS 


2  LRU1=INT( ATRIB( 2 ) ) 

LRU2-INT( ATRIB(9  )  ) 

IF  ( NNRSC ( LRU1 ) . LE . 0 }  GO  TO  40 
IF  (LRU2.LE.0)  GO  TO  35 
IF  ( NNRSC ( LRU2 ) . LE . 0 )  GO  TO  40 
CALL  SEIZE(LRU2, 1 ) 

35  CALL  SEIZE(LRU1, 1 ) 

I FLAG- -1 
40  RETURN 
END 


Model  Assumptions  and  Limitations 

-  Demand  Process  is  poisson. 

-  Demand  process  is  independant  o £  the  repair  process. 

-  The  repair  process  uses  times  drawn  from  an 
exponential  distribution  with  a  given  mean  repair 
cycle  time. 

-  Thirty  day  deployment. 

-  If  cannibalization  is  possible,  it  will  be 
instantaneous,  include  all  parts,  and  always  be 
successful. 

-  Capability  to  model  40  individual  LRUs  and  30  SRUs. 
The  rest  are  combined  into  an  overall  aircraft 
failure  rate. 

-  Maintenance  is  unconstrained. 

-  Mo  resupply. 

-  Ho  attrition. 

-  No  more  than  2  LRUfailures  per  sortie. 

-  The  sum  of  the  demand  rates  for  a  LRU's  SRUs  is  less 
than  or  equal  to  the  LRU  demand  rate. 

-  Selected  LRU  breaks  take  longer  to  fix  than  general 
aircraft  breaks. 


w* 
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C  THIS  IS  THE  DAILY  EXPECTED  VALUE  OUTPUTS  FOR  THE 
C  DYNA-METRIC  TAC  SAMPLE  DATA.  IT  GIVES  THE  DAY  OF  THE 


C  DEPLOYMENT,  THE  NUMBER  OF  EXPECTED  SORTIES  FLOWN,  AND 
C  THE  NUMBER  OF  FULLY  MISSION-CAPABLE  AIRCRAFT 
C 

DM  SORTIE  EMC. 


MI 

'* 

,«•* 

v= 


•'a 

vs 


s? 

** 

V 


'!« 

ft 

‘S 

*  I. 


& 


$ 


1 

55.2 

21.5 

2 

54.94 

18.91 

3 

53.83 

17.16 

4 

51.6 

15.61 

5 

48.5 

14.24 

6 

45 

13.01 

7 

41.47 

11.91 

8 

25.97 

12.2 

9 

26.04 

12.39 

10 

26.08 

12.61 

11 

26.11 

12.54 

12 

26.12 

12.51 

13 

26.13 

12.41 

14 

26.12 

12.25 

15 

26.10 

12.03 

16 

26.06 

11.75 

17 

25.99 

11.42 

18 

25.89 

11.03 

19 

25.72 

10.60 

20 

25.46 

10.12 

21 

25.09 

9.59 

22 

24.56 

9.01 

23 

23.84 

8.40 

24 

22.88 

7.76 

25 

21.67 

7.08 

26 

20.18 

6.39 

27 

18.44 

5.68 

28 

16.49 

4.96 

29 

14.37 

4.25 

30 

12.18 

3.55 
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^ 


•  I 

VI 


c 

C  THIS  IS  THE  DAILY  EXPECTED  VALUE  OUTPUTS  FOR  THE 
C  DYNA-METRIC  CORONET  WARRIOR  DATA.  IT  GIVES  THE  DAY  OF 
C  THE  DEPLOYMENT,  THE  NUMBER  OF  EXPECTED  SORTIES  FLOWN, 

C  AND  THE  NUMBER  OF  FULLY  MISSION-CAPABLE  AIRCRAFT 
C 


I2AX 

SORTIE 

FMC 

1 

55.2 

22.05 

2 

55.15 

20.03 

3 

55.19 

20.51 

4 

55.18 

20.21 

5 

55.16 

19.84 

6 

55.12 

19.47 

7 

55.07 

19.12 

8 

26.4 

19.35 

9 

26.4 

19.43 

10 

26.4 

19.43 

11 

26.4 

19.38 

12 

26.4 

19.29 

13 

26.4 

19.19 

14 

26.4 

19.07 

15 

26.4 

18.95 

16 

26.4 

18.81 

17 

26.4 

18.67 

18 

26.4 

18.53 

19 

26.4 

18.38 

20 

26.4 

18.23 

21 

26.4 

18.07 

22 

26.4 

17.91 

23 

26.4 

17.74 

24 

26.4 

17.56 

25 

26.4 

17.37 

26 

26.4 

17.16 

27 

26.4 

16.94 

28 

26.39 

16.69 

29 

26.39 

16.42 

30 

26.38 

16.11 
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C  TAC  SAMPLE  INPUT  DATA  FILE  FOR  THE  RESEARCH  MODEL 


C  CREATED  BY  THE  INTERACTIVE  INPUT  PROGRAM 
C 

24  -  NO.  OF  AIRCRAFT 

0.8154800  -  AIRCRAFT  DEMANDS/FLYING  HOUR 
1  -  1-CANNS  ALLOWED/  O-NO  CAN NS  ALLOWED 

35  -  NO.  OF  LRUS  MODELED 


PART  DEMAND 

LRU 

SXQCK 

QE 

REPAIR 

U£L_ 

RATE 

QPA 

LVL 

SRU 

NRTS 

TIME 

3 

3 . 8560000E-02 

2 

2 

0 

0.08 

6.000000 

18 

2 . 7039999E-02 

1 

1 

0 

0.1 

6.000000 

16 

0.02136000 

1 

3 

0 

0.09 

6.000000 

8 

8 . 7800000E-03 

2 

1 

0 

1 

6.000000 

33 

8 . 9499997E-03 

1 

3 

0 

1 

2.000000 

13 

5 . 2800001E-03 

2 

4 

0 

1 

6.000000 

28 

5 . 9099998E-03 

1 

0 

0 

0.36 

4.000000 

24 

3 . 1900001E-03 

1 

0 

0 

1 

3.000000 

31 

2 . 1660000E-02 

2 

13 

0 

1 

6.000000 

14 

4 . 4200001E-03 

2 

0 

0 

1 

6.000000 

19 

4 . 6100002E-03 

1 

0 

0 

0.04 

4.000000 

10 

4 . 1800001E-03 

2 

1 

0 

1 

6.000000 

27 

5 . 7500000E-03 

1 

2 

0 

0.21 

4.000000 

22 

1 . 0950000E-02 

1 

7 

0 

1 

3.000000 

21 

1.2040002E-02 

2 

7 

0 

1 

6.000000 

7 

2 . 1899999E-03 

1 

0 

0 

1 

3.000000 

35 

3 . 3400000E-03 

2 

0 

0 

1 

6.000000 

25 

2 . 0200000E-03 

1 

0 

0 

1 

5.000000 

11 

5 . 5200001E-03 

1 

3 

0 

1 

5.000000 

15 

3 . 0600000E-03 

2 

0 

0 

1 

6.000000 

9 

1 . 7900000E-03 

1 

0 

0 

1 

3.000000 

12 

3.9400002E-03 

1 

7 

0 

0.1 

4.000000 

26 

3 . 8400000E-03 

2 

1 

0 

1 

6.000000 

29 

1 . 6100000E-03 

1 

0 

0 

1 

6.000000 

6 

2.5800000E-03 

2 

0 

0 

1 

6.000000 

32 

3 . 6299999E-03 

1 

3 

0 

1 

6.000000 

4 

1 . 5000000E-03 

1 

0 

0 

1 

3.000000 

1 

2 . 4800000E-03 

2 

5 

0 

1 

6.000000 

5 

1 . 39  80000E-02 

1 

12 

0 

1 

5.000000 

17 

1 . 2700000E-03 

1 

0 

0 

1 

4.000000 

23 

4 . 0899999E-03 

1 

0 

0 

0.1 

3.000000 

20  1 . 1300000E-03 
36  8 . 6000003E-03 
34  6 . 7500002E-03 
2  3 . 6800002E-03 


10  0 

1  3  0 

12  0 

4  0  0 


1  3.000000 
0.01  5.000000 
0.15  4.000000 
1  6.000000 
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C  CORONET  WARRIOR  INPUT  DATA  FILE  FOR  THE  RESEARCH  MODEL 
C  CREATED  BY  THE  INTERACTIVE  INPUT  PROGRAM 
C 

24  -  NO.  OF  AIRCRAFT 

0.4649900  -  AIRCRAFT  DEMANDS/FLYING  HOUR 

1  -  1 -CAN NS  ALLOWED/  O-NO  CANNS  ALLOWED 

35  -  NO.  OF  LRUS  MODELED 


PART  DEMAND 

LRU 

STOCK 

NO.  OF 

REPAIR 

RATE 

QPA 

LVL 

SEIi 

NRTS 

TIME 

1 

1 . 2570000E-02 

1.000000 

0 

0 

0 

1.800000 

2 

2 . 8599999E-03 

1.000000 

0 

0 

1 

6.000000 

3 

1 . 3710000E-02 

1.000000 

3 

0 

0 

5.060000 

4 

2.2900000E-03 

1.000000 

0 

0 

1 

6.000000 

5 

4 . 5799999E-03 

2.000000 

1 

0 

1 

6.000000 

6 

1.5420000E-02 

2.000000 

2 

0 

0 

4.170000 

7 

8 . 5800001E-03 

2.000000 

0 

0 

0 

0.8800000 

8 

1 . 7100000E-03 

1.000000 

0 

0 

1 

5.000000 

9 

2.2799999E-03 

2.000000 

0 

0 

1 

6.000000 

10 

2 . 2900000E-03 

1.000000 

0 

0 

0 

0.9600000 

11 

8 . 0000004E-03 

1.000000 

0 

0 

0 

0.5100000 

12 

1 . 7100000E-03 

1.000000 

1 

0 

1 

6.000000 

13 

1 . 7100000E-03 

1.000000 

1 

0 

1 

6.000000 

14 

6.2799999E-03 

1.000000 

1 

0 

0 

3.210000 

15 

5 . 7199998E-03 

4.000000 

3 

0 

1 

2.000000 

16 

4 . 5699999E-03 

1.000000 

3 

0 

0 

9.880000 

17 

2 . 8599999E-03 

2.000000 

2 

0 

1 

6.000000 

18 

5 . 6999997E-04 

1.000000 

0 

0 

1 

5.000000 

19 

5 . 6999997E-04 

1.000000 

0 

0 

1 

6.000000 

20 

5 . 6999997E-04 

1.000000 

0 

0 

1 

6.000000 

21 

5 . 6999997E-04 

1.000000 

0 

0 

1 

3.000000 

22 

5 . 6999997E-04 

1.000000 

0 

0 

1 

6.000000 

23 

5 . 6999997E-04 

1.000000 

0 

0 

1 

4.000000 

24 

5 . 6999997E-04 

1.000000 

0 

0 

1 

2.000000 

25 

1 . 1399999E-03 

2.000000 

0 

0 

1 

5.000000 

26 

1 . 1399999E-03 

2.000000 

0 

0 

1 

6.000000 

27 

1 . 1399999E-03 

2.000000 

0 

0 

1 

6.000000 

28 

3 . 4300000E-03 

1.000000 

4 

0 

1 

6.000000 

29 

1 . 7199999E-03 

2.000000 

1 

0 

1 

5.000000 

30 

1 . 7199999E-03 

2.000000 

1 

0 

1 

6.000000 

31 

4 . 0000002E-03 

1.000000 

1 

0 

0 

2.480000 

32 

2 . 8599999E-03 

1.000000 

4 

0 

1 

6.000000 

33 

2 . 8599999E-03 

1.000000 

4 

0 

1 

6.000000 

34 

9 . 1399997E-03 

1.000000 

3 

0 

0 

1.910000 

35 

5 . 1400000E-03 

1.000000 

5 

0 

0 

13.48000 
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4 

# 

y.i 


•$ 

*»! 

■•*1' 


i 


| 

$ 


$ 

$ 

r- 

<1; 

/p 

V. 


REPAIR  TIMES  FOR  PART  NUMBER  6605010954108  IN  HOURS 


57.300 

61.500 

56.800 

53.300 

108.500 

32.800 

103.100 

84.900 

75.300 

161.000 

164.000 

179.500 

179.800 

33.900 

167.000 

245.500 

69.000 

37.000 

24.700 

25.800 

10.000 

44.900 

26.700 

13.500 

77.600 

63.200 

11.500 

61.600 

15.600 

19.200 

32.500 

57.200 

REPAIR  TIMES  FOR  PART  NUMBER  5865010668075  IN  HOURS 


93.700 

149.200 

9.100 

72.500 


68.300 

2.500 

6.200 

77.000 


210.500 

2.900 

72.000 

114.000 


98.000 

42.000 

32.800 

27.100 


110.800 

295.400 

97.800 

626.800 


6.300 

9.200 

76.700 


REPAIR  TIMES  FOR  PART  NUMBER  5841011007363  IN  HOURS 


39.000 

71.000 

7.600 

12.200 


39.200 

13.900 

8.300 

12.600 


43.300 
88.400 

13.300 

13.800 


32.700 

25.200 

358.100 


20.000 

14.800 

2.000 


18.000 

24.800 

6.300 


REPAIR  TIMES  FOR  PART  NUMBER  5841012348535  IN  HOURS 


8.200 

17.500 

16.000 

21.000 

8.200 

5.300 

18.000 

27.100 

30.800 

7.900 

27.000 

25.500 

49.800 

27.700 

65.100 

66.000 

8.500 

12.300 

38.500 

11.500 

5.100 

45.000 

140.000 

26.800 

8.000 

4.000 

48.000 

47.000 

7.300 

7.200 

8.800 

2.200 

13.000 

15.000 

9.300 

52.400 

5.500 

6.100 

11.100 

11.500 

11.500 

23.800 

8.700 

5.000 

17.600 

REPAIR  TIMES  FOR  PART  NUMBER  5841011356194  IN  HOURS 


31.000 

18.400 


35.300 

22.000 


44.500 

5.000 


32.800 

9.000 


10.800 

14.300 


17.600 

33.900 


'.«.y V’v.v.vrv v\* 


11.000 

18.000 

27.800 

21.900 

19.900 

21.200 

15.000 

22.300 

15.100 

212.300 

46.800 

9.800 

10.900 

16.800 

44.500 

9.200 

46.000 

41.800 

25.000 

6.100 

20.200 

14.200 

12.500 

7.800 

5.400 

3.900 

9.800 

42.700 

12.500 

15.900 

6.300 

7.300 

10.800 

4.100 

4.100 

11.800 

11.000 

K-S  TEST 


TEST 


CRITICAL 

STATISTIC 

DATA,  SET 

VALUE 

EXPONENTIAL 

LOGNORMAL 

1 

0.287 

0.209 

0.119 

2 

0.234 

0.129 

0.096 

3 

0.275 

0.173 

0.218 

4 

0.203 

0.151 

0.095 

5 

0.194 

0.157 

0.068 

NOTE 

:  ALPHA-0.05 

CHI -SQUARED  TEST 

TEST 

TEST 

CRITICAL 

STATISTIC 

CRITICAL 

STATISTIC 

DATA  SET  VALUE 

EXBflMBHTIAL 

VALUE 

LOGNORMAL 

1  5.991 

5.857 

3.841 

2.048 

2  9.488 

7.375 

7.815 

5.125 

3  5.991 

3.957 

3.841 

5.000 

4  14.067 

11.200 

12.592 

6.000 

5  14.067 

16.571 

12.592 

6.286 

NOTE 

:  ALPHA=0 .05 

j 

i 
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C  PROGRAM  USED  TO  CALCULATE  MEANS 

C  AND  PLOT  THE  RESULTS  (SAS  PROGRAM) 

C 

options  ls=80; 

FILENAME  NEWTEST3A.DAT'; 
data  new; 
infile  new; 

input  RUN  DAY  SORTIE  FMC; 
proc  SORT; 

BY  DAY; 

PROC  MEANS; 

BY  DAY; 

VAR  SORTIE  FMC; 

PROC  PLOT; 

PLOT  SORTIE*DAY  FMC* DAY; 


^1 

'r'i 

;*;i 


•v 

i 


>y< 

§ 


f,*' 

iWi 

■(  C*l 

«v< 

'W 

’•M 


1 


VARIANCE  PLOT  OF  50  RUNS  TAC  SAMPLE  DATA 


PLOT  OP  SORTIE* DAY  LEGEND:  A  -  1  OBS,  B  *  2  OBS,  BTC. 


SORTIE  I 

I 

55  ♦ 


Z  Z  Y  S  K 
A  B  AC 
A  B  D  B  D 
A  B  D 
B  B  B 
A  D  C  B  A 
ACHE 
B  D  A  A 
B  B  C  B 
C  D 
BAB 
B  A 
A  A 
B  B  A 
C  C 
B 
A 


zzzzzxuu 

C  A  B  C  C 

C  A  B  P  B  A 

AACPCDCG 
A  D  A  D  C  D  C 

A  C  B  B  C  B  A 

A  A 

A  B  B  B  0  B 

A  A  A  B 

A  B  ABA 

A  A  A  B 

A  A  C  B  D 

AAA 
A  A  B 

A  A 
A  A 


>  -’‘V-V’ 

v..  r,  , 


VARIANCE  PLOT  OF  50  RUNS  TAC  SAMPLE  DATA 


PLOT  OF  FMC*DAY 


LEGEND:  A  -  1  OBS,  B  »  2  OBS,  ETC. 


FMC 


24.0 

23.5 
23.0 

22.5 


13.5 
13.0 

12.5 
12.0 


A 

T 

R 

I 


BAA 


22.0 

•f 

B  H 

B 

B 

C 

A 

B 

C 

B 

A 

B 

A 

A 

B 

21.5 

L 

M 

F 

C 

D 

8 

B 

C 

E 

C 

D 

A 

D 

A 

A 

21.0 

+ 

G 

L 

K 

G 

F 

B 

C 

I 

G 

F 

F 

J 

a 

F 

E 

F 

C 

C 

B 

20.5 

♦ 

C 

D 

H 

K 

D 

I 

F 

B 

D 

B 

D 

C 

c 

B 

D 

B 

C 

B 

C 

B 

20.0 

+ 

B 

D 

1 

H 

I 

F 

I 

J 

H 

L 

X 

J 

1 

X 

L 

X 

X 

J 

I 

X 

L 

L 

G 

D 

B 

B 

C 

B 

B 

19.5 

♦ 

A 

C 

C 

G 

I 

H 

G 

C 

B 

H 

H 

D 

B 

B 

B 

F 

D 

C 

C 

D 

D 

C 

E 

C 

C 

A 

A 

19.0 

•f 

C 

B 

B 

E 

J 

F 

G 

F 

C 

I 

X 

X 

L 

I 

X 

I 

H 

G 

B 

G 

G 

B 

H 

F 

G 

F 

E 

E 

18.5 

♦ 

B 

a 

B 

A 

C 

F 

C 

E 

D 

A 

B 

D 

F 

A 

E 

B 

C 

B 

B 

A 

F 

D 

B 

C 

B 

A 

B 

18.0 

♦ 

A 

c 

B 

D 

B 

D 

D 

D 

E 

D 

E 

G 

J 

D 

G 

H 

G 

G 

H 

B 

G 

I 

D 

D 

C 

G 

17.5 

♦ 

A 

B 

A 

C 

D 

C 

D 

A 

A 

D 

a 

B 

A 

A 

B 

B 

F 

D 

C 

B 

B 

C 

D 

D 

B 

G 

B 

17.0 

♦ 

B 

C 

B 

A 

A 

c 

A 

A 

A 

B 

C 

B 

F 

G 

G 

F 

G 

H 

M 

Q 

M 

I 

16.5 

A 

B 

A 

A 

A 

A 

A 

A 

A 

B 

A 

A 

C 

D 

E 

B 

D 

E 

16.0 

♦ 

B 

B 

A 

B 

B 

B 

A 

B 

B 

C 

F 

D 

G 

E 

F 

H 

15.5 

+ 

A 

A 

C 

A 

A 

A 

C 

D 

C 

E 

A 

B 

A 

15.0 

♦ 

A 

A 

A 

A 

B 

A 

B 

c 

A 

B 

B 

A 

C 

14.5 

♦ 

A 

A 

A 

A 

B 

B 

B 

A 

14.0 

♦ 

A 

A 

A 

A 

A 

A 

B 

B 

A 

A 


-  + - + - 4 - 4 - 4 - 4 - 4 - 4 - 4- 

1  3  5  7  9  11  13  15  17 

DAY 


19 


•-4 - ♦- 

21  23 


25 


--4 - + 

27  29 


126 


VARIANCE  PLOT  OF  50  RUNS  CORONET  WARRIOR  DATA 


PMC  I 

23.5  ♦ 
23.0 

22.5 

22.0 

21. 5 
21.0 

20.5 

20.0 

19.5 
19.0 

18.5 


4.0 

3.5 
3.0 

2.5 

2.0 

1.5 

1.0 


PLOT  OP  PMC* DAT  LEGEND :  A  »  1  OBS,  B  -  2  OBS,  ETC. 


D 

P 

Q 

H 

D 

A 


P 

B 

G 

I 

G 

P 

G 


A 

A  A 


18.0 

♦ 

A 

B 

B 

A 

A 

A 

B 

A 

A 

17.5 

♦ 

B 

C 

D 

A 

B 

A 

A 

D 

A 

17.0 

♦ 

B 

G 

D 

D 

A 

A 

A 

C 

C 

D 

A 

A 

A 

A 

A 

A 

16.5 

♦ 

G 

C 

B 

A 

B 

C 

A 

B 

A 

B 

B 

B 

B 

A 

A 

A 

A 

16.0 

+ 

C 

P 

D 

C 

B 

B 

A 

A 

C 

B 

C 

E 

C 

B 

A 

A 

15.5 

•f 

A 

A 

C 

B 

A 

A 

C 

P 

B 

A 

D 

D 

B 

B 

C 

A 

B 

A 

A 

15.0 

+ 

A 

B 

0 

D 

B 

C 

P 

C 

C 

E 

P 

P 

B 

C 

D 

B 

A 

A 

A 

A 

A 

A 

A 

14.5 

+ 

A 

P 

A 

D 

B 

A 

D 

B 

G 

B 

B 

D 

P 

E 

A 

C 

D 

A 

A 

A 

A 

14.0 

♦ 

B 

C 

S 

E 

A 

B 

B 

D 

E 

D 

E 

C 

A 

P 

E 

B 

B 

C 

A 

B 

A 

A 

A 

A 

13.5 

♦ 

A 

A 

P 

A 

E 

H 

D 

C 

A 

C 

A 

c 

P 

D 

P 

P 

B 

C 

C 

A 

B 

B 

B 

A 

A 

13.0 

♦ 

P 

B 

B 

I 

D 

B 

B 

C 

B 

D 

E 

E 

D 

E 

A 

B 

B 

B 

A 

C 

B 

A 

A 

12.5 

+ 

A 

G 

G 

C 

A 

B 

P 

B 

C 

P 

C 

A 

C 

B 

P 

A 

E 

B 

D 

A 

B 

B 

A 

A 

12.0 

♦ 

D 

D 

C 

G 

E 

C 

E 

A 

A 

C 

E 

P 

P 

1 

D 

G 

c 

E 

D 

D 

B 

11.5 

♦ 

D 

B 

D 

D 

P 

D 

B 

P 

P 

B 

B 

B 

A 

B 

P 

P 

A 

B 

A 

C 

C 

A 

A 

B 

B 

11.0 

+ 

A 

E 

B 

C 

C 

D 

C 

C 

D 

E 

C 

B 

B 

D 

J 

B 

C 

C 

c 

B 

A 

A 

A 

10.5 

+ 

B 

D 

B 

C 

B 

B 

B 

A 

A 

A 

A 

B 

A 

A 

P 

C 

C 

C 

A 

c 

C 

C 

A 

B 

10.0 

♦ 

A 

B 

C 

B 

A 

B 

A 

B 

B 

A 

A 

B 

B 

D 

E 

E 

C 

A 

B 

A 

D 

B 

B 

9.5 

♦ 

C 

A 

B 

A 

B 

A 

D 

A 

B 

A 

A 

C 

D 

P 

C 

C 

B 

B 

D 

B 

A 

9.0 

♦ 

A 

B 

B 

A 

A 

A 

A 

C 

B 

C 

E 

C 

A 

P 

G 

P 

E 

A 

B 

C 

8.5 

♦ 

B 

A 

B 

A 

A 

A 

C 

C 

B 

C 

E 

a 

c 

G 

B 

B 

B 

B 

B 

8.0 

A 

A 

B 

B 

B 

c 

G 

E 

p 

B 

C 

C 

B 

C 

B 

7.5 

♦ 

A 

A 

A 

C 

D 

D 

B 

E 

A 

D 

D 

H 

7.0 

*■ 

A 

A 

A 

A 

A 

C 

C 

A 

D 

B 

C 

E 

D 

6.5 

♦ 

A 

A 

A 

D 

B 

H 

D 

D 

B 

6.0 

♦ 

A 

A 

B 

B 

B 

D 

G 

A 

A 

5.5 

+ 

A 

C 

C 

C 

D 

P 

5.0 

♦ 

B 

A 

B 

A 

D 

P 

C 

4.5 

♦ 

A 

C 

B 

A 

A 

B 

B  B 
A  A 


A 

A 


D  D 
A  B 
B  B  B 
A 


-+- 

5 


— + - + - ♦ - + - + - ♦ - +- 

11  13  15  17  19  21  23 

DAY 


■-+- 

25 


■-+- 

27 


--+ 

29 
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MODEL 

DAY  FMC  SORTIE 

1  22.55  55.00 

2  19.93  55.00 

3  17.81  54.80 

4  15.99  53.38 

5  14.35  51.10 

6  13.38  48.82 

7  12.77  47.34 

8  12.52  26.00 

9  13.11  26.00 

10  13.47  26.00 

11  13.53  26.00 

12  13.74  26.00 

13  13.69  26.00 

14  13.36  26.00 

15  13.07  25.98 

16  12.94  25.94 

17  12.75  25.94 

18  12.40  26.00 

19  11.98  26.00 

20  11.53  25.88 

21  10.92  25.96 

22  10.35  25.98 

23  9.98  25.82 

24  9.52  25.30 

25  8.87  24.58 

26  8.24  23.56 

27  7.64  22.88 

28  7.19  22.10 

29  6.97  21.42 

30  6.68  21.32 


MODEL 

EH£  SORTIE 

21.50  55.20 

18.91  54.94 

17.16  53.83 

15.61  51.60 

14.24  48.50 

13.01  45.00 

11.91  41.47 

12.20  25.97 

12.39  26.04 

12.61  26.08 

12.54  26.11 

12.51  26.12 

12.41  26.13 

12.25  26.12 

12.03  26.10 

11.75  26.06 

11.42  25.99 

11.03  25.89 

10.60  25.72 

10.12  25.46 

9.59  25.09 

9.01  24.56 

8.40  23.84 

7.76  22.88 

7.08  21.67 

6.39  20.18 

5.68  18.44 

4.96  16.49 

4.25  14.37 

3.55  12.18 


DAILY  OUTPUT  FOR 
CORONET  WARRIOR  DATA 


RESEARCH  DYNA-METRIC 

MODEL  MODEL 


DAY 

SORTIE 

FMC 

SORTIE 

1 

23.09 

55.00 

22.05 

55.20 

2 

21.78 

55.00 

20.03 

55.15 

3 

21.10 

55.00 

20.51 

55.19 

4 

20.56 

55.00 

20.21 

55.18 

5 

20.05 

55.00 

19.84 

55.16 

6 

19.63 

55.00 

19.47 

55.12 

7 

19.38 

54.94 

19.12 

55.07 

8 

19.43 

26.00 

19.35 

26.40 

9 

19.60 

26.00 

19.43 

26.40 

10 

19.72 

26.00 

19.43 

26.40 

11 

19.78 

26.00 

19.38 

26.40 

12 

19.73 

26.00 

19.29 

26.40 

13 

19.61 

26.00 

19.19 

26.40 

14 

19.46 

26.00 

19.07 

26.40 

15 

19.35 

26.00 

18.95 

26.40 

16 

19.22 

26.00 

18.81 

26.40 

17 

19.05 

26.00 

18.67 

26.40 

18 

18.82 

26.00 

18.53 

26.40 

19 

18.58 

26.00 

18.38 

26.40 

20 

18.43 

26.00 

18.23 

26.40 

21 

18.32 

26.00 

18.07 

26.40 

22 

18.20 

26.00 

17.91 

26.40 

23 

18.04 

26.00 

17.74 

26.40 

24 

17.86 

26.00 

17.56 

26.40 

25 

17.66 

26.00 

17  >  37 

26.40 

26 

17.37 

26.00 

17.16 

26.40 

27 

17.25 

26.00 

16.94 

26.40 

28 

17.18 

26.00 

16.69 

26.39 

29 

16.92 

26.00 

16.42 

26.39 

30 

16.74 

26.00 

16.11 

26.38 

PROGRAM  THAT  COMPUTED  THE  DIFFERENCES  BETWEEN  THE 


RESEARCH  MODEL  AND  THE  DYNA-METRIC  MODEL 
(FORTRAN  PROGRAM) 


PROGRAM  MAIN 
OPENS  DATA  FILES 

OPEN (UNIT* 7, FILE* ' TEST3A.DAT * , STATUS® ' OLD ' ) 
OPEN ( UNIT=8 , FILE* ' DYNA2 . DAT  * , STATUS* ' OLD ' ) 
OPEN (UNIT*9 , FILE* • DIFF . DAT • , STATUS* ' NEW* ) 


DO  10  1*1,30 

READS  IN  DATA 

READ (  7 ,  *  ) DAY , FMC, SORT 
READ ( 8 ,  * ) DAYl, SORTl , FMCl 

CALCULATES  DIFFERENCES 

DIFF*SORT-SORTl 
WR I TE (  9  ,  * )  D I FF 
DIFF=FMC-FMC1 
WRITE (9,*)DIFF 
CONTINUE 
CLOSE ( 7 ) 

CLOSE ( 8 ) 

CLOSE ( 9 ) 


C  DIFFERENCE  OUTPUT  FROM  TAC  SAMPLE 


DAY 

FMC 

SORTIES 

1 

1.05 

-0.20 

2 

1.02 

0.06 

3 

0.65 

0.97 

4 

0.38 

1.78 

5 

0.11 

2.60 

6 

0.37 

3.82 

7 

0.86 

5.87 

8 

0.32 

0.03 

9 

0.72 

-0.04 

10 

0.86 

-0.08 

11 

0.99 

-0.11 

12 

1.23 

-0.12 

13 

1.28 

-0.13 

14 

1.11 

-0.12 

15 

1.04 

-0.12 

16 

1.19 

-0.12 

17 

1.33 

-0.05 

18 

1.37 

0.11 

19 

1.38 

0.28 

20 

1.41 

0.42 

21 

1.33 

0.87 

22 

1.34 

1.42 

23 

1.58 

1.98 

24 

1.76 

2.42 

25 

1.79 

2.91 

26 

1.85 

3.38 

27 

1.96 

4.44 

28 

2.23 

5.61 

29 

2.72 

7.05 

30 

3.13 

9.14 

c 


DIFFERENCE  OUTPUT  FROM  CORONET  WARRIOR  DATA 


DAY 

FMC 

SORTIES 

1 

1.04 

-0.20 

2 

1.75 

-0.15 

3 

0.59 

-0.19 

4 

0.35 

-0.18 

5 

0.21 

-0.16 

6 

0.16 

-0.12 

7 

0.26 

-0.13 

8 

0.08 

-0.40 

9 

0.17 

-0.40 

10 

0.29 

-0.40 

11 

0.40 

-0.40 

12 

0.44 

-0.40 

13 

0.42 

-0.40 

14 

0.39 

-0.40 

15 

0.40 

-0.40 

16 

0.41 

-0.40 

17 

0.38 

-0.40 

18 

0.29 

-0.40 

19 

0.20 

-0.40 

20 

0.20 

-0.40 

21 

0.25 

-0.40 

22 

0.29 

-0.40 

23 

0.30 

-0.40 

24 

0.30 

-0.40 

25 

0.29 

-0.40 

26 

0.21 

-0.40 

27 

0.31 

-0.40 

28 

0.49 

-0.39 

29 

0.50 

-0.39 

30 

0.63 

-0.38 

133 


c 


C  CALCULATED  THE  MEANS  AND  STANDARD  DEVIATIONS  FOR 
C  THE  COMPUTED  DIFFERENCES  BETWEEN  THE  RESEARCH 
C  MODEL  AND  THE  DYNA-METRIC  MODEL 

C  (SAS  PROGRAM) 

C 


options  ls=80; 
filename  new'DIFF.dat 1 ; 
data  new; 
infile  new; 
input  DIFF; 

PROC  MEANS; 


C 

C  PROGRAM  USED  TO  PLOT  OUTPUT  DATA 
C  (SAS  PROGRAM) 

C 


options  ls=80; 

filename  new' TEST3A.DAT' ; 

data  new; 

infile  new; 

input  DAY  FMC  SORTIE; 

PROC  PLOT; 

PLOT  SORTIE*DAY  FMC*DAY; 
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FMC  I 

22  ♦ 


20  ♦ 
I 


RESEARCH  MODEL  OUTPUT  TAC  SAMPLE  DATA 


PLOT  or  PMC* DAY  LEGEND :  A  *  1  OBS,  B  *  2  OBS,  ETC. 


A  A  A  A 

A  A  A  A 

A  A  A 

A  A 


-♦ - ♦ - + - + - ♦ - ♦ - ♦ - + - ♦ - ♦ - 

9  11  13  15  17  19  21  23  25  27  29 


*  .  ■  *  *  . 1 
V  v ,  «V 


V.'V. 
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HQ  TAC/LGY  uses  Dyna-METRIC  as  a  WRSK  assessment  tool 
but  they  have  expressed  a  need  for  a  more  flexible  model 
that  Is  capable  of  running  on  a  microcomputer.  For  example, 
Dyna-METRIC  has  a  number  of  limiting  assumptions  such  as 
assuming  unlimited  maintenance  capacity.  The  purpose  of 
this  thesis  work  was  to  develop  a  model  to  emulate  and 
extend  the  Dyna-METRIC  modeling  capability. 

To  begin  this  research  a  simulation  package  had  to  be 
chosen.  Microcomputer  simulation  languages  were  compared 
and  SLAM  II  PC  was  selected  because  of  its  price, 
portability,  widespread  acceptance  as  a  simulation  language, 
and  the  availability  of  the  software. 

Another  area  of  concern  was  Dyna-METRIC ' s  use  of  the 
exponential  distribution  to  model  repair  times.  Questions 
have  arisen  as  to  whether  this  is  a  reasonable  assumption  or 
whether  the  lognormal  distribution  provides  a  better  fit. 

The  sample  repair  times  were  taken  from  a  TAC  exercise 
called  Coronet  Warrior.  The  results  were  inconclusive  due, 
primarily,  to  the  small  sample  sizes.  Testing  of  the 
research  model  centered  around  two  data  sets.  The  first  was 

provided  by  HQ  TAC/LGY  and  the  second  came  from  the  TAC 
Coronet  Warrior  exercise.  The  outputs  of  Interest  are 
sorties  per  day  and  number  of  fully  mission-capable  aircraft 
available  per  day.  Each  data  set  was  used  with  the  research 
and  Dyna-METRIC  models.  The  outputs  were  then  compared  by 
day  and  type.  A  hypothesis  test  of  the  differences  was 
performed.  The  differences  were  not  found  to  be 
stat istically  different  from  zero.  Therefore,  the  research 
model  provides  a  reasonable  emulation  of  the  Dyna-METRIC 
model  with  respect  to  the  outputs  of  Interest.  Future 
research  is  recommended  in  input  and  output  formats  and  in 
variance  reduction  techniques  to  reduce  the  number  of 
simulation  runs  necessary. 


